2023-07-19 14:10:09,931 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 14:10:10,192 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c 2023-07-19 14:10:10,192 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-19 14:10:10,192 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-19 14:10:10,237 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 14:10:10,478 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 14:10:10,479 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175, deleteOnExit=true 2023-07-19 14:10:10,479 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 14:10:10,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/test.cache.data in system properties and HBase conf 2023-07-19 14:10:10,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 14:10:10,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop.log.dir in system properties and HBase conf 2023-07-19 14:10:10,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 14:10:10,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 14:10:10,482 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 14:10:10,800 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 14:10:10,804 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:10,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:10,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 14:10:10,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:10,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 14:10:10,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 14:10:10,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:10,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:10,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 14:10:10,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/nfs.dump.dir in system properties and HBase conf 2023-07-19 14:10:10,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir in system properties and HBase conf 2023-07-19 14:10:10,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:10,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 14:10:10,808 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 14:10:11,402 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 14:10:11,406 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 14:10:11,680 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 14:10:11,857 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 14:10:11,876 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:11,919 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:11,959 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_localhost_36433_hdfs____.e0s8p1/webapp 2023-07-19 14:10:12,123 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36433 2023-07-19 14:10:12,175 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 14:10:12,176 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 14:10:12,676 WARN [Listener at localhost/40027] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:12,769 WARN [Listener at localhost/40027] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 14:10:12,790 WARN [Listener at localhost/40027] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:12,797 INFO [Listener at localhost/40027] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:12,803 INFO [Listener at localhost/40027] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_localhost_43759_datanode____5tsmqr/webapp 2023-07-19 14:10:12,905 INFO [Listener at localhost/40027] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43759 2023-07-19 14:10:13,442 WARN [Listener at localhost/33217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:13,486 WARN [Listener at localhost/33217] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 14:10:13,490 WARN [Listener at localhost/33217] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:13,493 INFO [Listener at localhost/33217] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:13,500 INFO [Listener at localhost/33217] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_localhost_43829_datanode____.f6rq7t/webapp 2023-07-19 14:10:13,636 INFO [Listener at localhost/33217] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43829 2023-07-19 14:10:13,655 WARN [Listener at localhost/40165] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:13,689 WARN [Listener at localhost/40165] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 14:10:13,692 WARN [Listener at localhost/40165] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:13,694 INFO [Listener at localhost/40165] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:13,699 INFO [Listener at localhost/40165] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_localhost_37115_datanode____.505s2w/webapp 2023-07-19 14:10:13,838 INFO [Listener at localhost/40165] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37115 2023-07-19 14:10:13,845 WARN [Listener at localhost/44257] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:14,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1a25130498c7d525: Processing first storage report for DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a from datanode d5290ae6-2576-49ae-858d-a6e1053f51eb 2023-07-19 14:10:14,164 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1a25130498c7d525: from storage DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a node DatanodeRegistration(127.0.0.1:38591, datanodeUuid=d5290ae6-2576-49ae-858d-a6e1053f51eb, infoPort=35677, infoSecurePort=0, ipcPort=33217, storageInfo=lv=-57;cid=testClusterID;nsid=1235968337;c=1689775811481), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,164 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f5960a2cb93b08c: Processing first storage report for DS-c42e113f-6be9-4675-b102-346bd97402b1 from datanode 6e8b9358-7c08-4666-b8f9-66d91e86081f 2023-07-19 14:10:14,164 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f5960a2cb93b08c: from storage DS-c42e113f-6be9-4675-b102-346bd97402b1 node DatanodeRegistration(127.0.0.1:37431, datanodeUuid=6e8b9358-7c08-4666-b8f9-66d91e86081f, infoPort=42855, infoSecurePort=0, ipcPort=40165, storageInfo=lv=-57;cid=testClusterID;nsid=1235968337;c=1689775811481), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,165 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1a25130498c7d525: Processing first storage report for DS-5430f18b-f6a3-4bcb-b8d6-6c9f953d4335 from datanode d5290ae6-2576-49ae-858d-a6e1053f51eb 2023-07-19 14:10:14,165 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1a25130498c7d525: from storage DS-5430f18b-f6a3-4bcb-b8d6-6c9f953d4335 node DatanodeRegistration(127.0.0.1:38591, datanodeUuid=d5290ae6-2576-49ae-858d-a6e1053f51eb, infoPort=35677, infoSecurePort=0, ipcPort=33217, storageInfo=lv=-57;cid=testClusterID;nsid=1235968337;c=1689775811481), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,165 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f5960a2cb93b08c: Processing first storage report for DS-231675a4-eaf6-4a88-a1b9-3af89aadb9a2 from datanode 6e8b9358-7c08-4666-b8f9-66d91e86081f 2023-07-19 14:10:14,165 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f5960a2cb93b08c: from storage DS-231675a4-eaf6-4a88-a1b9-3af89aadb9a2 node DatanodeRegistration(127.0.0.1:37431, datanodeUuid=6e8b9358-7c08-4666-b8f9-66d91e86081f, infoPort=42855, infoSecurePort=0, ipcPort=40165, storageInfo=lv=-57;cid=testClusterID;nsid=1235968337;c=1689775811481), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,394 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93e5d4aa419decc9: Processing first storage report for DS-24d95e65-df72-4bad-a1e8-e48ff73e7052 from datanode 988124fc-ee99-451d-acbc-1a8337a67598 2023-07-19 14:10:14,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93e5d4aa419decc9: from storage DS-24d95e65-df72-4bad-a1e8-e48ff73e7052 node DatanodeRegistration(127.0.0.1:41665, datanodeUuid=988124fc-ee99-451d-acbc-1a8337a67598, infoPort=42795, infoSecurePort=0, ipcPort=44257, storageInfo=lv=-57;cid=testClusterID;nsid=1235968337;c=1689775811481), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x93e5d4aa419decc9: Processing first storage report for DS-a932b243-2fc7-439c-9e67-1ea83d637fc4 from datanode 988124fc-ee99-451d-acbc-1a8337a67598 2023-07-19 14:10:14,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x93e5d4aa419decc9: from storage DS-a932b243-2fc7-439c-9e67-1ea83d637fc4 node DatanodeRegistration(127.0.0.1:41665, datanodeUuid=988124fc-ee99-451d-acbc-1a8337a67598, infoPort=42795, infoSecurePort=0, ipcPort=44257, storageInfo=lv=-57;cid=testClusterID;nsid=1235968337;c=1689775811481), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,453 DEBUG [Listener at localhost/44257] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c 2023-07-19 14:10:14,547 INFO [Listener at localhost/44257] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/zookeeper_0, clientPort=54361, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 14:10:14,567 INFO [Listener at localhost/44257] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54361 2023-07-19 14:10:14,579 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:14,582 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:15,291 INFO [Listener at localhost/44257] util.FSUtils(471): Created version file at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 with version=8 2023-07-19 14:10:15,291 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/hbase-staging 2023-07-19 14:10:15,664 INFO [Listener at localhost/44257] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 14:10:16,272 INFO [Listener at localhost/44257] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:16,309 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,309 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,309 INFO [Listener at localhost/44257] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:16,310 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,310 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:16,469 INFO [Listener at localhost/44257] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:16,562 DEBUG [Listener at localhost/44257] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 14:10:16,682 INFO [Listener at localhost/44257] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42625 2023-07-19 14:10:16,701 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:16,704 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:16,735 INFO [Listener at localhost/44257] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42625 connecting to ZooKeeper ensemble=127.0.0.1:54361 2023-07-19 14:10:16,791 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:426250x0, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:16,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42625-0x1017deb3a810000 connected 2023-07-19 14:10:16,840 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:16,841 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:16,857 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:16,867 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42625 2023-07-19 14:10:16,870 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42625 2023-07-19 14:10:16,874 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42625 2023-07-19 14:10:16,875 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42625 2023-07-19 14:10:16,878 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42625 2023-07-19 14:10:16,888 INFO [Listener at localhost/44257] master.HMaster(444): hbase.rootdir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, hbase.cluster.distributed=false 2023-07-19 14:10:16,953 INFO [Listener at localhost/44257] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:16,953 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,954 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,954 INFO [Listener at localhost/44257] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:16,954 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,954 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:16,959 INFO [Listener at localhost/44257] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:16,964 INFO [Listener at localhost/44257] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42107 2023-07-19 14:10:16,968 INFO [Listener at localhost/44257] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 14:10:16,977 INFO [Listener at localhost/44257] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 14:10:16,979 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:16,982 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:16,984 INFO [Listener at localhost/44257] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42107 connecting to ZooKeeper ensemble=127.0.0.1:54361 2023-07-19 14:10:16,988 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:421070x0, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:16,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42107-0x1017deb3a810001 connected 2023-07-19 14:10:16,991 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:16,993 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:17,000 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:17,001 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42107 2023-07-19 14:10:17,001 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42107 2023-07-19 14:10:17,002 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42107 2023-07-19 14:10:17,014 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42107 2023-07-19 14:10:17,015 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42107 2023-07-19 14:10:17,029 INFO [Listener at localhost/44257] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:17,029 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,029 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,030 INFO [Listener at localhost/44257] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:17,030 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,030 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:17,030 INFO [Listener at localhost/44257] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:17,032 INFO [Listener at localhost/44257] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44997 2023-07-19 14:10:17,033 INFO [Listener at localhost/44257] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 14:10:17,038 INFO [Listener at localhost/44257] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 14:10:17,039 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,048 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,050 INFO [Listener at localhost/44257] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44997 connecting to ZooKeeper ensemble=127.0.0.1:54361 2023-07-19 14:10:17,057 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:449970x0, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:17,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44997-0x1017deb3a810002 connected 2023-07-19 14:10:17,058 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:17,059 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:17,060 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:17,063 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44997 2023-07-19 14:10:17,063 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44997 2023-07-19 14:10:17,063 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44997 2023-07-19 14:10:17,067 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44997 2023-07-19 14:10:17,067 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44997 2023-07-19 14:10:17,081 INFO [Listener at localhost/44257] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:17,081 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,081 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,081 INFO [Listener at localhost/44257] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:17,081 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,081 INFO [Listener at localhost/44257] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:17,082 INFO [Listener at localhost/44257] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:17,084 INFO [Listener at localhost/44257] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34233 2023-07-19 14:10:17,085 INFO [Listener at localhost/44257] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 14:10:17,086 INFO [Listener at localhost/44257] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 14:10:17,087 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,089 INFO [Listener at localhost/44257] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,090 INFO [Listener at localhost/44257] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34233 connecting to ZooKeeper ensemble=127.0.0.1:54361 2023-07-19 14:10:17,101 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:342330x0, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:17,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34233-0x1017deb3a810003 connected 2023-07-19 14:10:17,104 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:17,106 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:17,107 DEBUG [Listener at localhost/44257] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:17,109 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34233 2023-07-19 14:10:17,109 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34233 2023-07-19 14:10:17,110 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34233 2023-07-19 14:10:17,114 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34233 2023-07-19 14:10:17,114 DEBUG [Listener at localhost/44257] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34233 2023-07-19 14:10:17,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:17,130 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 14:10:17,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:17,161 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,161 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,161 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,161 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,162 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:17,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 14:10:17,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42625,1689775815479 from backup master directory 2023-07-19 14:10:17,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 14:10:17,169 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:17,169 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 14:10:17,170 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:17,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:17,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 14:10:17,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 14:10:17,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/hbase.id with ID: 8ab220ce-bc36-4876-9684-541e75ec99d4 2023-07-19 14:10:17,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,373 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:17,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4108a756 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:17,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21d51ca0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:17,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:17,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 14:10:17,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 14:10:17,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 14:10:17,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 14:10:17,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 14:10:17,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:17,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store-tmp 2023-07-19 14:10:17,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:17,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 14:10:17,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 14:10:17,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 14:10:17,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/WALs/jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:17,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42625%2C1689775815479, suffix=, logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/WALs/jenkins-hbase4.apache.org,42625,1689775815479, archiveDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/oldWALs, maxLogs=10 2023-07-19 14:10:17,759 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK] 2023-07-19 14:10:17,759 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK] 2023-07-19 14:10:17,759 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK] 2023-07-19 14:10:17,771 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 14:10:17,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/WALs/jenkins-hbase4.apache.org,42625,1689775815479/jenkins-hbase4.apache.org%2C42625%2C1689775815479.1689775817692 2023-07-19 14:10:17,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK], DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK], DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK]] 2023-07-19 14:10:17,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:17,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:17,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:17,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:17,987 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:17,999 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 14:10:18,036 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 14:10:18,053 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:18,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74110178, jitterRate=0.10432770848274231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:18,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 14:10:18,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 14:10:18,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 14:10:18,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 14:10:18,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 14:10:18,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 14:10:18,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 40 msec 2023-07-19 14:10:18,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 14:10:18,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 14:10:18,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 14:10:18,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 14:10:18,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 14:10:18,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 14:10:18,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 14:10:18,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 14:10:18,246 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 14:10:18,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 14:10:18,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 14:10:18,268 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,269 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,269 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,268 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,269 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42625,1689775815479, sessionid=0x1017deb3a810000, setting cluster-up flag (Was=false) 2023-07-19 14:10:18,293 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 14:10:18,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:18,319 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 14:10:18,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:18,333 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp 2023-07-19 14:10:18,425 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(951): ClusterId : 8ab220ce-bc36-4876-9684-541e75ec99d4 2023-07-19 14:10:18,442 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(951): ClusterId : 8ab220ce-bc36-4876-9684-541e75ec99d4 2023-07-19 14:10:18,439 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(951): ClusterId : 8ab220ce-bc36-4876-9684-541e75ec99d4 2023-07-19 14:10:18,454 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 14:10:18,455 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 14:10:18,454 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 14:10:18,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 14:10:18,465 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 14:10:18,465 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 14:10:18,465 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 14:10:18,466 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 14:10:18,467 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 14:10:18,467 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 14:10:18,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 14:10:18,470 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 14:10:18,472 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ReadOnlyZKClient(139): Connect 0x6132e8fe to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:18,473 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 14:10:18,473 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 14:10:18,483 DEBUG [RS:2;jenkins-hbase4:34233] zookeeper.ReadOnlyZKClient(139): Connect 0x54df8342 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:18,483 DEBUG [RS:1;jenkins-hbase4:44997] zookeeper.ReadOnlyZKClient(139): Connect 0x5ddd21f8 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:18,508 DEBUG [RS:2;jenkins-hbase4:34233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35b7116b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:18,509 DEBUG [RS:2;jenkins-hbase4:34233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cfb5f03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:10:18,508 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d3132cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:18,511 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c3641ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:10:18,515 DEBUG [RS:1;jenkins-hbase4:44997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@531ac433, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:18,515 DEBUG [RS:1;jenkins-hbase4:44997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1227ce08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:10:18,540 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44997 2023-07-19 14:10:18,540 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42107 2023-07-19 14:10:18,547 INFO [RS:1;jenkins-hbase4:44997] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 14:10:18,548 INFO [RS:1;jenkins-hbase4:44997] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 14:10:18,548 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34233 2023-07-19 14:10:18,548 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 14:10:18,548 INFO [RS:2;jenkins-hbase4:34233] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 14:10:18,553 INFO [RS:2;jenkins-hbase4:34233] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 14:10:18,551 INFO [RS:0;jenkins-hbase4:42107] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 14:10:18,555 INFO [RS:0;jenkins-hbase4:42107] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 14:10:18,555 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 14:10:18,555 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 14:10:18,556 INFO [RS:2;jenkins-hbase4:34233] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,556 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 14:10:18,556 INFO [RS:0;jenkins-hbase4:42107] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,557 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 14:10:18,552 INFO [RS:1;jenkins-hbase4:44997] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,561 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 14:10:18,561 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42625,1689775815479 with isa=jenkins-hbase4.apache.org/172.31.14.131:42107, startcode=1689775816952 2023-07-19 14:10:18,562 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42625,1689775815479 with isa=jenkins-hbase4.apache.org/172.31.14.131:44997, startcode=1689775817028 2023-07-19 14:10:18,562 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42625,1689775815479 with isa=jenkins-hbase4.apache.org/172.31.14.131:34233, startcode=1689775817080 2023-07-19 14:10:18,585 DEBUG [RS:1;jenkins-hbase4:44997] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 14:10:18,586 DEBUG [RS:2;jenkins-hbase4:34233] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 14:10:18,587 DEBUG [RS:0;jenkins-hbase4:42107] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 14:10:18,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 14:10:18,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 14:10:18,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:18,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:18,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:18,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689775848671 2023-07-19 14:10:18,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 14:10:18,695 DEBUG [PEWorker-3] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 14:10:18,695 INFO [PEWorker-3] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 14:10:18,704 INFO [PEWorker-3] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:18,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 14:10:18,716 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57783, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 14:10:18,716 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44979, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 14:10:18,718 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54287, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 14:10:18,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 14:10:18,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 14:10:18,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 14:10:18,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 14:10:18,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 14:10:18,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 14:10:18,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 14:10:18,731 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42625] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 14:10:18,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 14:10:18,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 14:10:18,746 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42625] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 14:10:18,747 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42625] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 14:10:18,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689775818746,5,FailOnTimeoutGroup] 2023-07-19 14:10:18,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689775818755,5,FailOnTimeoutGroup] 2023-07-19 14:10:18,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 14:10:18,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,815 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 14:10:18,815 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 14:10:18,816 WARN [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 14:10:18,815 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 14:10:18,817 WARN [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 14:10:18,816 WARN [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 14:10:18,823 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:18,824 INFO [PEWorker-3] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:18,824 INFO [PEWorker-3] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:18,868 DEBUG [PEWorker-3] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:18,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 14:10:18,876 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/info 2023-07-19 14:10:18,878 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 14:10:18,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 14:10:18,883 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/rep_barrier 2023-07-19 14:10:18,883 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 14:10:18,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 14:10:18,886 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/table 2023-07-19 14:10:18,887 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 14:10:18,888 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,889 DEBUG [PEWorker-3] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740 2023-07-19 14:10:18,891 DEBUG [PEWorker-3] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740 2023-07-19 14:10:18,896 DEBUG [PEWorker-3] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 14:10:18,898 DEBUG [PEWorker-3] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 14:10:18,902 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:18,903 INFO [PEWorker-3] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69394570, jitterRate=0.03405967354774475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 14:10:18,903 DEBUG [PEWorker-3] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 14:10:18,903 DEBUG [PEWorker-3] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 14:10:18,903 INFO [PEWorker-3] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 14:10:18,903 DEBUG [PEWorker-3] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 14:10:18,903 DEBUG [PEWorker-3] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 14:10:18,903 DEBUG [PEWorker-3] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 14:10:18,905 INFO [PEWorker-3] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 14:10:18,905 DEBUG [PEWorker-3] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 14:10:18,913 DEBUG [PEWorker-3] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 14:10:18,913 INFO [PEWorker-3] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 14:10:18,917 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42625,1689775815479 with isa=jenkins-hbase4.apache.org/172.31.14.131:42107, startcode=1689775816952 2023-07-19 14:10:18,918 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42625,1689775815479 with isa=jenkins-hbase4.apache.org/172.31.14.131:44997, startcode=1689775817028 2023-07-19 14:10:18,921 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42625,1689775815479 with isa=jenkins-hbase4.apache.org/172.31.14.131:34233, startcode=1689775817080 2023-07-19 14:10:18,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 14:10:18,931 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42625] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:18,938 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42625] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:18,939 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:18,939 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40027 2023-07-19 14:10:18,939 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 14:10:18,944 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42625] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:18,945 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:18,945 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40027 2023-07-19 14:10:18,945 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 14:10:18,946 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:18,946 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40027 2023-07-19 14:10:18,946 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 14:10:18,953 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 14:10:18,961 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 14:10:19,028 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:10:19,113 DEBUG [jenkins-hbase4:42625] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 14:10:19,117 DEBUG [jenkins-hbase4:42625] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:19,124 DEBUG [jenkins-hbase4:42625] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:19,124 DEBUG [jenkins-hbase4:42625] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:19,124 DEBUG [jenkins-hbase4:42625] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:19,124 DEBUG [jenkins-hbase4:42625] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:19,127 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34233,1689775817080, state=OPENING 2023-07-19 14:10:19,209 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,209 WARN [RS:0;jenkins-hbase4:42107] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:19,209 INFO [RS:0;jenkins-hbase4:42107] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,210 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,210 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34233,1689775817080] 2023-07-19 14:10:19,210 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42107,1689775816952] 2023-07-19 14:10:19,210 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44997,1689775817028] 2023-07-19 14:10:19,282 DEBUG [RS:2;jenkins-hbase4:34233] zookeeper.ZKUtil(162): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,282 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 14:10:19,282 DEBUG [RS:1;jenkins-hbase4:44997] zookeeper.ZKUtil(162): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,282 WARN [RS:2;jenkins-hbase4:34233] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:19,283 WARN [RS:1;jenkins-hbase4:44997] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:19,283 INFO [RS:2;jenkins-hbase4:34233] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,284 INFO [RS:1;jenkins-hbase4:44997] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,284 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,284 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,467 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:19,468 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,468 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 14:10:19,468 DEBUG [RS:2;jenkins-hbase4:34233] zookeeper.ZKUtil(162): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,469 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,471 DEBUG [RS:1;jenkins-hbase4:44997] zookeeper.ZKUtil(162): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,471 DEBUG [RS:2;jenkins-hbase4:34233] zookeeper.ZKUtil(162): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,471 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,471 DEBUG [RS:1;jenkins-hbase4:44997] zookeeper.ZKUtil(162): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,472 DEBUG [RS:1;jenkins-hbase4:44997] zookeeper.ZKUtil(162): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:10:19,475 DEBUG [RS:2;jenkins-hbase4:34233] zookeeper.ZKUtil(162): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,486 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 14:10:19,486 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 14:10:19,486 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 14:10:19,500 INFO [RS:0;jenkins-hbase4:42107] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 14:10:19,510 INFO [RS:1;jenkins-hbase4:44997] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 14:10:19,511 INFO [RS:2;jenkins-hbase4:34233] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 14:10:19,528 INFO [RS:0;jenkins-hbase4:42107] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 14:10:19,530 INFO [RS:2;jenkins-hbase4:34233] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 14:10:19,530 INFO [RS:1;jenkins-hbase4:44997] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 14:10:19,533 INFO [RS:1;jenkins-hbase4:44997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 14:10:19,533 INFO [RS:2;jenkins-hbase4:34233] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 14:10:19,533 INFO [RS:0;jenkins-hbase4:42107] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 14:10:19,534 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,534 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,534 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,535 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 14:10:19,535 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 14:10:19,535 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 14:10:19,545 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,545 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,545 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:1;jenkins-hbase4:44997] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,545 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,545 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,547 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,547 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,547 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,547 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,547 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,547 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:19,548 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:19,548 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,548 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,549 DEBUG [RS:2;jenkins-hbase4:34233] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,549 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,550 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,551 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,551 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,557 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,574 INFO [RS:0;jenkins-hbase4:42107] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 14:10:19,580 INFO [RS:1;jenkins-hbase4:44997] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 14:10:19,574 INFO [RS:2;jenkins-hbase4:34233] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 14:10:19,583 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42107,1689775816952-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,583 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34233,1689775817080-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,583 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44997,1689775817028-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,620 INFO [RS:2;jenkins-hbase4:34233] regionserver.Replication(203): jenkins-hbase4.apache.org,34233,1689775817080 started 2023-07-19 14:10:19,620 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34233,1689775817080, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34233, sessionid=0x1017deb3a810003 2023-07-19 14:10:19,620 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 14:10:19,620 DEBUG [RS:2;jenkins-hbase4:34233] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,620 DEBUG [RS:2;jenkins-hbase4:34233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34233,1689775817080' 2023-07-19 14:10:19,621 DEBUG [RS:2;jenkins-hbase4:34233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 14:10:19,622 DEBUG [RS:2;jenkins-hbase4:34233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 14:10:19,622 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 14:10:19,622 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 14:10:19,623 DEBUG [RS:2;jenkins-hbase4:34233] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,623 DEBUG [RS:2;jenkins-hbase4:34233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34233,1689775817080' 2023-07-19 14:10:19,623 DEBUG [RS:2;jenkins-hbase4:34233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:19,624 INFO [RS:1;jenkins-hbase4:44997] regionserver.Replication(203): jenkins-hbase4.apache.org,44997,1689775817028 started 2023-07-19 14:10:19,624 DEBUG [RS:2;jenkins-hbase4:34233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:19,624 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44997,1689775817028, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44997, sessionid=0x1017deb3a810002 2023-07-19 14:10:19,625 DEBUG [RS:2;jenkins-hbase4:34233] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 14:10:19,625 INFO [RS:2;jenkins-hbase4:34233] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 14:10:19,625 INFO [RS:2;jenkins-hbase4:34233] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 14:10:19,625 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 14:10:19,625 DEBUG [RS:1;jenkins-hbase4:44997] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,625 INFO [RS:0;jenkins-hbase4:42107] regionserver.Replication(203): jenkins-hbase4.apache.org,42107,1689775816952 started 2023-07-19 14:10:19,627 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42107,1689775816952, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42107, sessionid=0x1017deb3a810001 2023-07-19 14:10:19,627 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 14:10:19,627 DEBUG [RS:0;jenkins-hbase4:42107] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,627 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42107,1689775816952' 2023-07-19 14:10:19,627 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 14:10:19,628 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 14:10:19,629 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 14:10:19,629 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 14:10:19,626 DEBUG [RS:1;jenkins-hbase4:44997] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44997,1689775817028' 2023-07-19 14:10:19,629 DEBUG [RS:1;jenkins-hbase4:44997] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 14:10:19,629 DEBUG [RS:0;jenkins-hbase4:42107] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:19,630 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42107,1689775816952' 2023-07-19 14:10:19,630 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:19,630 DEBUG [RS:1;jenkins-hbase4:44997] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 14:10:19,630 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:19,631 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 14:10:19,631 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 14:10:19,631 DEBUG [RS:1;jenkins-hbase4:44997] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:19,631 DEBUG [RS:1;jenkins-hbase4:44997] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44997,1689775817028' 2023-07-19 14:10:19,631 DEBUG [RS:1;jenkins-hbase4:44997] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:19,631 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 14:10:19,631 INFO [RS:0;jenkins-hbase4:42107] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 14:10:19,632 DEBUG [RS:1;jenkins-hbase4:44997] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:19,632 INFO [RS:0;jenkins-hbase4:42107] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 14:10:19,635 DEBUG [RS:1;jenkins-hbase4:44997] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 14:10:19,635 INFO [RS:1;jenkins-hbase4:44997] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 14:10:19,635 INFO [RS:1;jenkins-hbase4:44997] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 14:10:19,667 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:19,670 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:10:19,674 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:10:19,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 14:10:19,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34233%2C1689775817080.meta, suffix=.meta, logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,34233,1689775817080, archiveDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs, maxLogs=32 2023-07-19 14:10:19,717 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK] 2023-07-19 14:10:19,718 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK] 2023-07-19 14:10:19,718 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK] 2023-07-19 14:10:19,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,34233,1689775817080/jenkins-hbase4.apache.org%2C34233%2C1689775817080.meta.1689775819698.meta 2023-07-19 14:10:19,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK], DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK], DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK]] 2023-07-19 14:10:19,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:19,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 14:10:19,729 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:19,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 14:10:19,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 14:10:19,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 14:10:19,746 INFO [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42107%2C1689775816952, suffix=, logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,42107,1689775816952, archiveDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs, maxLogs=32 2023-07-19 14:10:19,748 INFO [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34233%2C1689775817080, suffix=, logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,34233,1689775817080, archiveDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs, maxLogs=32 2023-07-19 14:10:19,746 INFO [RS:1;jenkins-hbase4:44997] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44997%2C1689775817028, suffix=, logDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,44997,1689775817028, archiveDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs, maxLogs=32 2023-07-19 14:10:19,770 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 14:10:19,771 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:19,776 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK] 2023-07-19 14:10:19,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 14:10:19,784 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK] 2023-07-19 14:10:19,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 14:10:19,784 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK] 2023-07-19 14:10:19,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 14:10:19,856 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/info 2023-07-19 14:10:19,864 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/info 2023-07-19 14:10:19,865 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 14:10:19,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:19,868 INFO [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,34233,1689775817080/jenkins-hbase4.apache.org%2C34233%2C1689775817080.1689775819750 2023-07-19 14:10:19,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 14:10:19,873 DEBUG [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK], DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK], DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK]] 2023-07-19 14:10:19,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/rep_barrier 2023-07-19 14:10:19,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/rep_barrier 2023-07-19 14:10:19,874 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 14:10:19,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:19,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 14:10:19,882 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK] 2023-07-19 14:10:19,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/table 2023-07-19 14:10:19,885 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/table 2023-07-19 14:10:19,886 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 14:10:19,887 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:19,890 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK] 2023-07-19 14:10:19,890 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK] 2023-07-19 14:10:19,891 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK] 2023-07-19 14:10:19,892 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK] 2023-07-19 14:10:19,892 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK] 2023-07-19 14:10:19,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740 2023-07-19 14:10:19,907 INFO [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,42107,1689775816952/jenkins-hbase4.apache.org%2C42107%2C1689775816952.1689775819750 2023-07-19 14:10:19,909 DEBUG [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK], DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK], DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK]] 2023-07-19 14:10:19,910 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740 2023-07-19 14:10:19,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 14:10:19,915 INFO [RS:1;jenkins-hbase4:44997] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/WALs/jenkins-hbase4.apache.org,44997,1689775817028/jenkins-hbase4.apache.org%2C44997%2C1689775817028.1689775819761 2023-07-19 14:10:19,915 DEBUG [RS:1;jenkins-hbase4:44997] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38591,DS-fc2e3bb9-6714-4f83-ae7e-ad015f41352a,DISK], DatanodeInfoWithStorage[127.0.0.1:41665,DS-24d95e65-df72-4bad-a1e8-e48ff73e7052,DISK], DatanodeInfoWithStorage[127.0.0.1:37431,DS-c42e113f-6be9-4675-b102-346bd97402b1,DISK]] 2023-07-19 14:10:19,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 14:10:19,928 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69663764, jitterRate=0.03807097673416138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 14:10:19,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 14:10:19,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689775819658 2023-07-19 14:10:20,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 14:10:20,011 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 14:10:20,012 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34233,1689775817080, state=OPEN 2023-07-19 14:10:20,036 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 14:10:20,036 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 14:10:20,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 14:10:20,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34233,1689775817080 in 562 msec 2023-07-19 14:10:20,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 14:10:20,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.1190 sec 2023-07-19 14:10:20,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5760 sec 2023-07-19 14:10:20,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689775820062, completionTime=-1 2023-07-19 14:10:20,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 14:10:20,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 14:10:20,136 DEBUG [hconnection-0x3aa4d515-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:20,140 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:20,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 14:10:20,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689775880166 2023-07-19 14:10:20,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689775940166 2023-07-19 14:10:20,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 103 msec 2023-07-19 14:10:20,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42625,1689775815479-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42625,1689775815479-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42625,1689775815479-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42625, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,292 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 14:10:20,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 14:10:20,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:20,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 14:10:20,326 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:20,330 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:20,361 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,366 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797 empty. 2023-07-19 14:10:20,367 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,368 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 14:10:20,456 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:20,458 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41f064f5da0c02f7e97975bd4958c797, NAME => 'hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 41f064f5da0c02f7e97975bd4958c797, disabling compactions & flushes 2023-07-19 14:10:20,492 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. after waiting 0 ms 2023-07-19 14:10:20,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,493 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,493 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 41f064f5da0c02f7e97975bd4958c797: 2023-07-19 14:10:20,499 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:20,515 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689775820502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775820502"}]},"ts":"1689775820502"} 2023-07-19 14:10:20,544 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 14:10:20,546 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:20,555 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775820546"}]},"ts":"1689775820546"} 2023-07-19 14:10:20,561 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 14:10:20,567 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:20,569 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:20,569 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:20,569 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:20,569 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:20,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=41f064f5da0c02f7e97975bd4958c797, ASSIGN}] 2023-07-19 14:10:20,577 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=41f064f5da0c02f7e97975bd4958c797, ASSIGN 2023-07-19 14:10:20,580 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=41f064f5da0c02f7e97975bd4958c797, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44997,1689775817028; forceNewPlan=false, retain=false 2023-07-19 14:10:20,733 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 14:10:20,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=41f064f5da0c02f7e97975bd4958c797, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:20,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689775820734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775820734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775820734"}]},"ts":"1689775820734"} 2023-07-19 14:10:20,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 41f064f5da0c02f7e97975bd4958c797, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:10:20,897 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:20,898 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:10:20,902 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:10:20,911 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,911 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41f064f5da0c02f7e97975bd4958c797, NAME => 'hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:20,912 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. service=AccessControlService 2023-07-19 14:10:20,913 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:20,913 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,913 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:20,913 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,913 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,920 INFO [StoreOpener-41f064f5da0c02f7e97975bd4958c797-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,925 DEBUG [StoreOpener-41f064f5da0c02f7e97975bd4958c797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/info 2023-07-19 14:10:20,925 DEBUG [StoreOpener-41f064f5da0c02f7e97975bd4958c797-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/info 2023-07-19 14:10:20,926 INFO [StoreOpener-41f064f5da0c02f7e97975bd4958c797-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41f064f5da0c02f7e97975bd4958c797 columnFamilyName info 2023-07-19 14:10:20,927 INFO [StoreOpener-41f064f5da0c02f7e97975bd4958c797-1] regionserver.HStore(310): Store=41f064f5da0c02f7e97975bd4958c797/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:20,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,937 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:10:20,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:20,944 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41f064f5da0c02f7e97975bd4958c797; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64185923, jitterRate=-0.04355521500110626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:20,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41f064f5da0c02f7e97975bd4958c797: 2023-07-19 14:10:20,948 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797., pid=6, masterSystemTime=1689775820897 2023-07-19 14:10:20,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,954 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:10:20,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=41f064f5da0c02f7e97975bd4958c797, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:20,961 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689775820960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775820960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775820960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775820960"}]},"ts":"1689775820960"} 2023-07-19 14:10:20,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 14:10:20,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 41f064f5da0c02f7e97975bd4958c797, server=jenkins-hbase4.apache.org,44997,1689775817028 in 224 msec 2023-07-19 14:10:20,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 14:10:20,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=41f064f5da0c02f7e97975bd4958c797, ASSIGN in 401 msec 2023-07-19 14:10:20,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:20,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775820981"}]},"ts":"1689775820981"} 2023-07-19 14:10:20,985 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 14:10:20,991 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:20,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 681 msec 2023-07-19 14:10:21,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 14:10:21,027 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 14:10:21,028 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:21,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:21,059 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:21,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 14:10:21,119 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 14:10:21,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 55 msec 2023-07-19 14:10:21,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 14:10:21,151 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 14:10:21,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-07-19 14:10:21,172 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 14:10:21,176 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 14:10:21,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.007sec 2023-07-19 14:10:21,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 14:10:21,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 14:10:21,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 14:10:21,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42625,1689775815479-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 14:10:21,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42625,1689775815479-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 14:10:21,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:21,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 14:10:21,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:21,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:21,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 14:10:21,224 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/acl/435f3294234ae2acd05812673d039929 empty. 2023-07-19 14:10:21,228 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 14:10:21,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,247 DEBUG [Listener at localhost/44257] zookeeper.ReadOnlyZKClient(139): Connect 0x44136387 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:21,272 DEBUG [Listener at localhost/44257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@468646d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:21,292 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:21,301 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 435f3294234ae2acd05812673d039929, NAME => 'hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:10:21,315 DEBUG [hconnection-0x448f8d1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:21,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,338 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:21,347 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:10:21,347 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 14:10:21,348 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/test.cache.data in system properties and HBase conf 2023-07-19 14:10:21,348 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 14:10:21,348 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop.log.dir in system properties and HBase conf 2023-07-19 14:10:21,348 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:21,348 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 14:10:21,348 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 435f3294234ae2acd05812673d039929, disabling compactions & flushes 2023-07-19 14:10:21,348 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 14:10:21,348 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 14:10:21,348 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,348 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,349 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. after waiting 0 ms 2023-07-19 14:10:21,349 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,349 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:21,349 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,349 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:21,349 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 435f3294234ae2acd05812673d039929: 2023-07-19 14:10:21,349 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 14:10:21,349 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:21,349 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 14:10:21,350 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 14:10:21,350 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:21,350 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:21,350 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 14:10:21,351 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/nfs.dump.dir in system properties and HBase conf 2023-07-19 14:10:21,351 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir in system properties and HBase conf 2023-07-19 14:10:21,351 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:21,351 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 14:10:21,351 INFO [Listener at localhost/44257] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 14:10:21,355 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:21,357 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689775821357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775821357"}]},"ts":"1689775821357"} 2023-07-19 14:10:21,361 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 14:10:21,363 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:21,363 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775821363"}]},"ts":"1689775821363"} 2023-07-19 14:10:21,367 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 14:10:21,372 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:21,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:21,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:21,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:21,374 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:21,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN}] 2023-07-19 14:10:21,379 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN 2023-07-19 14:10:21,383 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:10:21,534 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 14:10:21,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=435f3294234ae2acd05812673d039929, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:21,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689775821535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775821535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775821535"}]},"ts":"1689775821535"} 2023-07-19 14:10:21,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 435f3294234ae2acd05812673d039929, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:10:21,701 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 435f3294234ae2acd05812673d039929, NAME => 'hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:21,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. service=AccessControlService 2023-07-19 14:10:21,702 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:21,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:21,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,706 INFO [StoreOpener-435f3294234ae2acd05812673d039929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,709 DEBUG [StoreOpener-435f3294234ae2acd05812673d039929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/l 2023-07-19 14:10:21,709 DEBUG [StoreOpener-435f3294234ae2acd05812673d039929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/l 2023-07-19 14:10:21,710 INFO [StoreOpener-435f3294234ae2acd05812673d039929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 435f3294234ae2acd05812673d039929 columnFamilyName l 2023-07-19 14:10:21,711 INFO [StoreOpener-435f3294234ae2acd05812673d039929-1] regionserver.HStore(310): Store=435f3294234ae2acd05812673d039929/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:21,717 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,718 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:21,733 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 435f3294234ae2acd05812673d039929; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64577371, jitterRate=-0.037722185254096985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:21,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 435f3294234ae2acd05812673d039929: 2023-07-19 14:10:21,735 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929., pid=11, masterSystemTime=1689775821693 2023-07-19 14:10:21,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,739 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,742 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=435f3294234ae2acd05812673d039929, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:21,742 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689775821742"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775821742"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775821742"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775821742"}]},"ts":"1689775821742"} 2023-07-19 14:10:21,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 14:10:21,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 435f3294234ae2acd05812673d039929, server=jenkins-hbase4.apache.org,34233,1689775817080 in 208 msec 2023-07-19 14:10:21,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 14:10:21,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN in 378 msec 2023-07-19 14:10:21,761 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:21,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775821761"}]},"ts":"1689775821761"} 2023-07-19 14:10:21,765 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 14:10:21,769 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:21,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 560 msec 2023-07-19 14:10:21,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 14:10:21,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 14:10:22,518 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:22,827 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:22,833 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39557_jobhistory____l4cu6y/webapp 2023-07-19 14:10:23,005 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 14:10:23,005 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:23,005 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:23,008 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:23,071 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:23,352 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:23,672 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 14:10:23,703 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39557 2023-07-19 14:10:24,014 WARN [Listener at jenkins-hbase4.apache.org/33661] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:24,379 WARN [Listener at jenkins-hbase4.apache.org/33661] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 14:10:24,381 INFO [Listener at jenkins-hbase4.apache.org/33661] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:24,390 INFO [Listener at jenkins-hbase4.apache.org/33661] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36953_cluster____vru0uo/webapp 2023-07-19 14:10:24,481 INFO [Listener at jenkins-hbase4.apache.org/33661] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:24,481 INFO [Listener at jenkins-hbase4.apache.org/33661] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 14:10:24,482 INFO [Listener at jenkins-hbase4.apache.org/33661] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:24,482 INFO [Listener at jenkins-hbase4.apache.org/33661] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:24,494 INFO [Listener at jenkins-hbase4.apache.org/33661] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:24,710 INFO [Listener at jenkins-hbase4.apache.org/33661] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:24,914 INFO [Listener at jenkins-hbase4.apache.org/33661] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:24,930 INFO [Listener at jenkins-hbase4.apache.org/33661] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36953 2023-07-19 14:10:25,390 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:10:25,615 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 14:10:25,617 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 14:10:25,618 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 14:10:25,661 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:25,662 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 14:10:25,662 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:25,662 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 14:10:25,662 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 14:10:25,663 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 14:10:25,663 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:25,664 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 14:10:25,664 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 14:10:25,664 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 14:10:25,881 WARN [Listener at jenkins-hbase4.apache.org/33635] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:25,907 WARN [Listener at jenkins-hbase4.apache.org/33635] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 14:10:25,907 INFO [Listener at jenkins-hbase4.apache.org/33635] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:25,914 INFO [Listener at jenkins-hbase4.apache.org/33635] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39887_node____o3v427/webapp 2023-07-19 14:10:25,976 INFO [Listener at jenkins-hbase4.apache.org/33635] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 14:10:25,976 INFO [Listener at jenkins-hbase4.apache.org/33635] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:25,976 INFO [Listener at jenkins-hbase4.apache.org/33635] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:25,976 INFO [Listener at jenkins-hbase4.apache.org/33635] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:25,985 INFO [Listener at jenkins-hbase4.apache.org/33635] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,010 INFO [Listener at jenkins-hbase4.apache.org/33635] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,118 INFO [Listener at jenkins-hbase4.apache.org/33635] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,136 INFO [Listener at jenkins-hbase4.apache.org/33635] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39887 2023-07-19 14:10:26,469 WARN [Listener at jenkins-hbase4.apache.org/37607] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:26,478 WARN [Listener at jenkins-hbase4.apache.org/37607] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 14:10:26,479 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:26,494 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36597_node____wkrqby/webapp 2023-07-19 14:10:26,556 INFO [Listener at jenkins-hbase4.apache.org/37607] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 14:10:26,557 INFO [Listener at jenkins-hbase4.apache.org/37607] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:26,557 INFO [Listener at jenkins-hbase4.apache.org/37607] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:26,557 INFO [Listener at jenkins-hbase4.apache.org/37607] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:26,565 INFO [Listener at jenkins-hbase4.apache.org/37607] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,581 INFO [Listener at jenkins-hbase4.apache.org/37607] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,651 INFO [Listener at jenkins-hbase4.apache.org/37607] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,659 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36597 2023-07-19 14:10:26,688 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 14:10:26,690 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:26,764 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=175, AvailableMemoryMB=4947 2023-07-19 14:10:26,764 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-07-19 14:10:26,777 DEBUG [Listener at jenkins-hbase4.apache.org/37607] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 14:10:26,783 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 14:10:26,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 14:10:26,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:26,798 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:26,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 14:10:26,802 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:26,808 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:26,809 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 empty. 2023-07-19 14:10:26,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:26,812 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:26,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:26,814 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 empty. 2023-07-19 14:10:26,816 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:26,816 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 14:10:26,865 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:26,867 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 87287787f5abbeb88e168e1236392f37, NAME => 'testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:10:26,867 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e52aed595c7bd6eba73393ed7c600201, NAME => 'testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:10:26,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:26,920 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:26,921 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e52aed595c7bd6eba73393ed7c600201, disabling compactions & flushes 2023-07-19 14:10:26,921 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:26,921 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:26,921 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. after waiting 0 ms 2023-07-19 14:10:26,921 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:26,921 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:26,921 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e52aed595c7bd6eba73393ed7c600201: 2023-07-19 14:10:26,922 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:26,922 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 87287787f5abbeb88e168e1236392f37, disabling compactions & flushes 2023-07-19 14:10:26,923 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:26,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:26,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. after waiting 0 ms 2023-07-19 14:10:26,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:26,923 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:26,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 87287787f5abbeb88e168e1236392f37: 2023-07-19 14:10:26,926 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:26,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775826928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775826928"}]},"ts":"1689775826928"} 2023-07-19 14:10:26,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775826928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775826928"}]},"ts":"1689775826928"} 2023-07-19 14:10:26,983 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:10:26,985 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:26,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775826986"}]},"ts":"1689775826986"} 2023-07-19 14:10:26,988 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 14:10:26,993 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:26,996 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:26,996 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:26,996 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:26,996 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:26,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, ASSIGN}] 2023-07-19 14:10:27,000 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, ASSIGN 2023-07-19 14:10:27,000 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, ASSIGN 2023-07-19 14:10:27,001 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:10:27,001 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44997,1689775817028; forceNewPlan=false, retain=false 2023-07-19 14:10:27,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:27,151 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:10:27,154 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=87287787f5abbeb88e168e1236392f37, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:27,154 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e52aed595c7bd6eba73393ed7c600201, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:27,154 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775827154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775827154"}]},"ts":"1689775827154"} 2023-07-19 14:10:27,154 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775827154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775827154"}]},"ts":"1689775827154"} 2023-07-19 14:10:27,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure e52aed595c7bd6eba73393ed7c600201, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:10:27,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 87287787f5abbeb88e168e1236392f37, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:10:27,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e52aed595c7bd6eba73393ed7c600201, NAME => 'testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:10:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. service=AccessControlService 2023-07-19 14:10:27,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:27,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,320 INFO [StoreOpener-e52aed595c7bd6eba73393ed7c600201-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,322 DEBUG [StoreOpener-e52aed595c7bd6eba73393ed7c600201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf 2023-07-19 14:10:27,322 DEBUG [StoreOpener-e52aed595c7bd6eba73393ed7c600201-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf 2023-07-19 14:10:27,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:27,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87287787f5abbeb88e168e1236392f37, NAME => 'testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:10:27,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. service=AccessControlService 2023-07-19 14:10:27,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:27,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:27,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,326 INFO [StoreOpener-e52aed595c7bd6eba73393ed7c600201-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e52aed595c7bd6eba73393ed7c600201 columnFamilyName cf 2023-07-19 14:10:27,326 INFO [StoreOpener-87287787f5abbeb88e168e1236392f37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,328 DEBUG [StoreOpener-87287787f5abbeb88e168e1236392f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf 2023-07-19 14:10:27,328 DEBUG [StoreOpener-87287787f5abbeb88e168e1236392f37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf 2023-07-19 14:10:27,329 INFO [StoreOpener-e52aed595c7bd6eba73393ed7c600201-1] regionserver.HStore(310): Store=e52aed595c7bd6eba73393ed7c600201/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:27,330 INFO [StoreOpener-87287787f5abbeb88e168e1236392f37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87287787f5abbeb88e168e1236392f37 columnFamilyName cf 2023-07-19 14:10:27,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,332 INFO [StoreOpener-87287787f5abbeb88e168e1236392f37-1] regionserver.HStore(310): Store=87287787f5abbeb88e168e1236392f37/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:27,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:27,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:27,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:27,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:27,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e52aed595c7bd6eba73393ed7c600201; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59192411, jitterRate=-0.11796434223651886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:27,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e52aed595c7bd6eba73393ed7c600201: 2023-07-19 14:10:27,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87287787f5abbeb88e168e1236392f37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67934014, jitterRate=0.012295693159103394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:27,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87287787f5abbeb88e168e1236392f37: 2023-07-19 14:10:27,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201., pid=15, masterSystemTime=1689775827310 2023-07-19 14:10:27,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37., pid=16, masterSystemTime=1689775827319 2023-07-19 14:10:27,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:27,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:27,355 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e52aed595c7bd6eba73393ed7c600201, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:27,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:27,355 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827355"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775827355"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775827355"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775827355"}]},"ts":"1689775827355"} 2023-07-19 14:10:27,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:27,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=87287787f5abbeb88e168e1236392f37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:27,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775827357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775827357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775827357"}]},"ts":"1689775827357"} 2023-07-19 14:10:27,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-19 14:10:27,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure e52aed595c7bd6eba73393ed7c600201, server=jenkins-hbase4.apache.org,44997,1689775817028 in 203 msec 2023-07-19 14:10:27,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-19 14:10:27,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 87287787f5abbeb88e168e1236392f37, server=jenkins-hbase4.apache.org,34233,1689775817080 in 203 msec 2023-07-19 14:10:27,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, ASSIGN in 367 msec 2023-07-19 14:10:27,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 14:10:27,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, ASSIGN in 370 msec 2023-07-19 14:10:27,369 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:27,370 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775827369"}]},"ts":"1689775827369"} 2023-07-19 14:10:27,371 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 14:10:27,374 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:27,379 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 14:10:27,396 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 14:10:27,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:27,427 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,427 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,427 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,427 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,428 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:27,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 645 msec 2023-07-19 14:10:27,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:27,925 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 14:10:27,929 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 14:10:27,931 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:27,933 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:27,969 DEBUG [hconnection-0x448f8d1-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:27,973 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:27,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:27,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775827992 (current time:1689775827992). 2023-07-19 14:10:27,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:27,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x038bc559 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:28,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d18872f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:28,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,008 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x038bc559 to 127.0.0.1:54361 2023-07-19 14:10:28,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:28,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x19975002 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:28,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a6a0938, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:28,026 DEBUG [hconnection-0x564f5a9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,029 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19975002 to 127.0.0.1:54361 2023-07-19 14:10:28,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:28,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 14:10:28,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:28,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,087 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,089 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689776428089 2023-07-19 14:10:28,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 14:10:28,092 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-19 14:10:28,096 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,097 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689776428097 2023-07-19 14:10:28,098 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:28,098 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:28,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,135 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 14:10:28,135 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,135 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 14:10:28,135 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 14:10:28,136 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,136 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,141 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,141 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,141 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,141 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,142 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,142 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,143 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,143 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 14:10:28,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,144 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,147 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,147 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,147 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,147 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,148 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,148 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,149 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,149 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,149 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,148 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,149 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,150 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,150 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,149 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,150 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,152 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,152 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,153 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,154 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:28,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbf226d[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:28,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:28,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbf226d[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:28,161 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 14:10:28,161 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,163 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,163 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,163 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,164 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,164 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,165 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,165 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:10:28,165 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:28,165 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:28,165 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:28,165 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:28,165 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. started... 2023-07-19 14:10:28,167 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87287787f5abbeb88e168e1236392f37: 2023-07-19 14:10:28,168 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,171 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:28,171 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:28,171 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:28,171 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,171 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. started... 2023-07-19 14:10:28,171 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,172 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,173 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e52aed595c7bd6eba73393ed7c600201: 2023-07-19 14:10:28,173 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,176 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:28,176 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:28,180 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:28,180 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:28,198 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,201 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. completed. 2023-07-19 14:10:28,201 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. completed. 2023-07-19 14:10:28,201 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:28,201 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:28,201 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:28,201 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:28,201 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:10:28,202 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:10:28,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,204 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,204 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,205 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,205 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,206 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:28,206 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,207 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44997,1689775817028': 2023-07-19 14:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 14:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:10:28,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 14:10:28,218 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 14:10:28,218 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:28,218 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:28,219 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,219 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:28,221 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,221 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,221 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,221 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,223 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,223 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,224 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,226 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,241 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 14:10:28,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:10:28,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 14:10:28,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 14:10:28,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,384 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689775828089Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689775828272 (+183 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689775828272Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689775828272Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689775828287 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689775828326 (+39 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689775828383 (+57 ms) 2023-07-19 14:10:28,386 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 294 msec 2023-07-19 14:10:28,407 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:28,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:28,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44997] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:28,431 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 14:10:28,431 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:28,431 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:28,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775828445 (current time:1689775828445). 2023-07-19 14:10:28,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:28,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x52ef62b3 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:28,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3629a6fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:28,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,457 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ef62b3 to 127.0.0.1:54361 2023-07-19 14:10:28,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:28,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x6a5b9e2f to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:28,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4308832d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:28,467 DEBUG [hconnection-0x386debc9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,468 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a5b9e2f to 127.0.0.1:54361 2023-07-19 14:10:28,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:28,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 14:10:28,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:28,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,479 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,480 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689776428480 2023-07-19 14:10:28,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 14:10:28,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,482 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:28,482 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:28,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,483 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-19 14:10:28,486 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,487 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689776428487 2023-07-19 14:10:28,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 14:10:28,505 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 14:10:28,505 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,506 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 14:10:28,506 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 14:10:28,507 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,507 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,509 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,509 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,509 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,509 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,510 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,510 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,510 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,510 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,511 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,511 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 14:10:28,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 14:10:28,511 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,511 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,511 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,511 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 14:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,513 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 14:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,514 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,514 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,514 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,515 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,515 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,516 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,517 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4fda0a[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:28,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c4fda0a[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:28,523 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 14:10:28,523 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,527 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,527 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,527 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,528 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:10:28,528 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:28,528 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:28,528 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:28,528 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:28,529 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. started... 2023-07-19 14:10:28,528 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. started... 2023-07-19 14:10:28,529 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87287787f5abbeb88e168e1236392f37 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 14:10:28,529 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e52aed595c7bd6eba73393ed7c600201 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 14:10:28,531 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,531 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,531 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,582 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:28,584 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:28,682 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307196ad821d51012487585430decf3dfd9cb to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196ad821d51012487585430decf3dfd9cb 2023-07-19 14:10:28,682 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719d901c224c7374a4983a28b87050ccea7 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719d901c224c7374a4983a28b87050ccea7 2023-07-19 14:10:28,716 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/.tmp/cf/087e7dee5c054dcb86f3889a6d399c59 2023-07-19 14:10:28,717 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/.tmp/cf/0f256474106b407f9476baae0edb425b 2023-07-19 14:10:28,727 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/.tmp/cf/087e7dee5c054dcb86f3889a6d399c59 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf/087e7dee5c054dcb86f3889a6d399c59 2023-07-19 14:10:28,728 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/.tmp/cf/0f256474106b407f9476baae0edb425b as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf/0f256474106b407f9476baae0edb425b 2023-07-19 14:10:28,738 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf/087e7dee5c054dcb86f3889a6d399c59, entries=45, sequenceid=6, filesize=12.5 K 2023-07-19 14:10:28,738 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf/0f256474106b407f9476baae0edb425b, entries=5, sequenceid=6, filesize=5.7 K 2023-07-19 14:10:28,744 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 87287787f5abbeb88e168e1236392f37 in 215ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:28,744 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 14:10:28,744 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e52aed595c7bd6eba73393ed7c600201 in 215ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:28,745 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 14:10:28,746 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87287787f5abbeb88e168e1236392f37: 2023-07-19 14:10:28,746 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e52aed595c7bd6eba73393ed7c600201: 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf/0f256474106b407f9476baae0edb425b] hfiles 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf/0f256474106b407f9476baae0edb425b for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf/087e7dee5c054dcb86f3889a6d399c59] hfiles 2023-07-19 14:10:28,747 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf/087e7dee5c054dcb86f3889a6d399c59 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:28,784 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,785 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. completed. 2023-07-19 14:10:28,785 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:28,785 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:28,785 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:28,786 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,786 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,786 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:10:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:28,787 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:10:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,796 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,797 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:28,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:28,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44997,1689775817028': 2023-07-19 14:10:28,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 14:10:29,088 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:29,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:29,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:29,090 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 14:10:29,187 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. completed. 2023-07-19 14:10:29,187 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:29,187 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:29,187 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:29,187 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,187 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:29,187 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:10:29,189 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:10:29,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 14:10:29,197 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 14:10:29,197 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:29,198 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:29,198 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 14:10:29,198 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:29,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,201 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,202 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,203 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,207 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,212 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,212 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,215 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:29,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:29,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 14:10:29,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:29,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:29,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,231 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:29,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:29,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:10:29,232 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719d901c224c7374a4983a28b87050ccea7, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196ad821d51012487585430decf3dfd9cb] mob files 2023-07-19 14:10:29,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719d901c224c7374a4983a28b87050ccea7 2023-07-19 14:10:29,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196ad821d51012487585430decf3dfd9cb 2023-07-19 14:10:29,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 14:10:29,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 14:10:29,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,399 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689775828480Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689775829278 (+798 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689775829278Loading Region manifests for snaptb0-testExportWithTargetName at 1689775829278Writing data manifest for snaptb0-testExportWithTargetName at 1689775829291 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689775829339 (+48 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689775829398 (+59 ms) 2023-07-19 14:10:29,401 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:29,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 920 msec 2023-07-19 14:10:29,590 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:29,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:29,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:29,594 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593 2023-07-19 14:10:29,594 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40027, tgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593, rawTgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:29,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:29,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1921720834_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 14:10:29,652 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 14:10:29,690 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 14:10:29,843 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,844 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,845 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,845 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,846 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,963 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-4495909092825776833.jar 2023-07-19 14:10:29,963 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,964 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,965 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,965 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,966 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,967 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,967 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:10:29,968 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:10:29,969 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:10:29,969 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:10:29,970 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:10:29,971 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:10:29,971 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:10:29,972 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:10:29,972 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:10:29,973 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:10:29,977 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,978 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,978 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:29,978 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:29,980 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:31,076 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:10:31,083 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 14:10:31,093 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 14:10:31,629 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:31,630 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:31,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:32,840 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:10:37,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:39,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:43,178 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:45,060 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:10:45,063 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:10:45,074 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 14:10:45,074 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:10:45,075 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:10:45,075 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 14:10:45,076 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 14:10:45,076 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 14:10:45,076 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593/.hbase-snapshot/testExportWithTargetName 2023-07-19 14:10:45,077 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 14:10:45,077 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775829593/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 14:10:45,089 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 14:10:45,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 14:10:45,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,107 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775845107"}]},"ts":"1689775845107"} 2023-07-19 14:10:45,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 14:10:45,109 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 14:10:45,111 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 14:10:45,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, UNASSIGN}] 2023-07-19 14:10:45,115 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, UNASSIGN 2023-07-19 14:10:45,115 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, UNASSIGN 2023-07-19 14:10:45,116 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e52aed595c7bd6eba73393ed7c600201, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:45,117 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=87287787f5abbeb88e168e1236392f37, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:45,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775845116"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775845116"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775845116"}]},"ts":"1689775845116"} 2023-07-19 14:10:45,117 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775845116"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775845116"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775845116"}]},"ts":"1689775845116"} 2023-07-19 14:10:45,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e52aed595c7bd6eba73393ed7c600201, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:10:45,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 87287787f5abbeb88e168e1236392f37, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:10:45,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 14:10:45,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:45,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87287787f5abbeb88e168e1236392f37, disabling compactions & flushes 2023-07-19 14:10:45,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:45,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:45,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. after waiting 0 ms 2023-07-19 14:10:45,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:45,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:45,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e52aed595c7bd6eba73393ed7c600201, disabling compactions & flushes 2023-07-19 14:10:45,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:45,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:45,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. after waiting 0 ms 2023-07-19 14:10:45,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:45,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:10:45,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:10:45,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:45,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:45,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37. 2023-07-19 14:10:45,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87287787f5abbeb88e168e1236392f37: 2023-07-19 14:10:45,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201. 2023-07-19 14:10:45,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e52aed595c7bd6eba73393ed7c600201: 2023-07-19 14:10:45,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:45,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=87287787f5abbeb88e168e1236392f37, regionState=CLOSED 2023-07-19 14:10:45,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775845311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775845311"}]},"ts":"1689775845311"} 2023-07-19 14:10:45,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:45,313 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e52aed595c7bd6eba73393ed7c600201, regionState=CLOSED 2023-07-19 14:10:45,313 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775845313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775845313"}]},"ts":"1689775845313"} 2023-07-19 14:10:45,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 14:10:45,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 87287787f5abbeb88e168e1236392f37, server=jenkins-hbase4.apache.org,34233,1689775817080 in 196 msec 2023-07-19 14:10:45,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 14:10:45,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e52aed595c7bd6eba73393ed7c600201, server=jenkins-hbase4.apache.org,44997,1689775817028 in 198 msec 2023-07-19 14:10:45,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87287787f5abbeb88e168e1236392f37, UNASSIGN in 206 msec 2023-07-19 14:10:45,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-19 14:10:45,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e52aed595c7bd6eba73393ed7c600201, UNASSIGN in 207 msec 2023-07-19 14:10:45,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775845331"}]},"ts":"1689775845331"} 2023-07-19 14:10:45,333 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 14:10:45,335 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 14:10:45,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 239 msec 2023-07-19 14:10:45,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 14:10:45,411 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 14:10:45,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 14:10:45,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 14:10:45,428 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,431 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 14:10:45,434 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:45,434 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:45,435 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:45,435 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:45,435 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:45,435 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:45,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 14:10:45,438 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:45,438 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,438 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,438 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,438 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 14:10:45,438 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/recovered.edits] 2023-07-19 14:10:45,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 14:10:45,438 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 14:10:45,438 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 14:10:45,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 14:10:45,438 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/recovered.edits] 2023-07-19 14:10:45,438 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 14:10:45,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 14:10:45,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf/0f256474106b407f9476baae0edb425b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/cf/0f256474106b407f9476baae0edb425b 2023-07-19 14:10:45,446 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf/087e7dee5c054dcb86f3889a6d399c59 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/cf/087e7dee5c054dcb86f3889a6d399c59 2023-07-19 14:10:45,450 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37/recovered.edits/9.seqid 2023-07-19 14:10:45,450 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201/recovered.edits/9.seqid 2023-07-19 14:10:45,451 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/87287787f5abbeb88e168e1236392f37 2023-07-19 14:10:45,451 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportWithTargetName/e52aed595c7bd6eba73393ed7c600201 2023-07-19 14:10:45,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 14:10:45,451 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 14:10:45,452 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-19 14:10:45,456 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719d901c224c7374a4983a28b87050ccea7 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719d901c224c7374a4983a28b87050ccea7 2023-07-19 14:10:45,458 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196ad821d51012487585430decf3dfd9cb to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196ad821d51012487585430decf3dfd9cb 2023-07-19 14:10:45,458 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 14:10:45,461 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,482 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 14:10:45,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 14:10:45,486 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,486 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 14:10:45,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775845486"}]},"ts":"9223372036854775807"} 2023-07-19 14:10:45,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775845486"}]},"ts":"9223372036854775807"} 2023-07-19 14:10:45,489 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:10:45,489 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87287787f5abbeb88e168e1236392f37, NAME => 'testtb-testExportWithTargetName,,1689775826789.87287787f5abbeb88e168e1236392f37.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e52aed595c7bd6eba73393ed7c600201, NAME => 'testtb-testExportWithTargetName,1,1689775826789.e52aed595c7bd6eba73393ed7c600201.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:10:45,489 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 14:10:45,489 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775845489"}]},"ts":"9223372036854775807"} 2023-07-19 14:10:45,491 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 14:10:45,493 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:45,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 76 msec 2023-07-19 14:10:45,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 14:10:45,545 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 14:10:45,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 14:10:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:45,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 14:10:45,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 14:10:45,604 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 702) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1285895013_1 at /127.0.0.1:38766 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:43621 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:35947 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1285895013_1 at /127.0.0.1:47946 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:47966 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:49686 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:33635 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:38800 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3147 (was 4947) 2023-07-19 14:10:45,605 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-19 14:10:45,627 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=181, AvailableMemoryMB=3145 2023-07-19 14:10:45,627 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-19 14:10:45,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 14:10:45,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:10:45,635 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:45,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 14:10:45,638 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:45,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:45,641 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:45,641 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:45,642 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad empty. 2023-07-19 14:10:45,642 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 empty. 2023-07-19 14:10:45,643 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:45,643 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:45,643 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 14:10:45,655 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:45,657 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e283f04fb8012d59be6462a9fb278b85, NAME => 'testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:10:45,657 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4fcbacbe4ef95c9d082a1717d5f962ad, NAME => 'testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:10:45,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:45,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e283f04fb8012d59be6462a9fb278b85, disabling compactions & flushes 2023-07-19 14:10:45,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:45,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:45,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. after waiting 0 ms 2023-07-19 14:10:45,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:45,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:45,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e283f04fb8012d59be6462a9fb278b85: 2023-07-19 14:10:45,684 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:45,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4fcbacbe4ef95c9d082a1717d5f962ad, disabling compactions & flushes 2023-07-19 14:10:45,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:45,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:45,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. after waiting 0 ms 2023-07-19 14:10:45,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:45,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:45,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4fcbacbe4ef95c9d082a1717d5f962ad: 2023-07-19 14:10:45,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:45,690 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775845689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775845689"}]},"ts":"1689775845689"} 2023-07-19 14:10:45,690 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775845689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775845689"}]},"ts":"1689775845689"} 2023-07-19 14:10:45,693 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:10:45,695 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:45,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775845695"}]},"ts":"1689775845695"} 2023-07-19 14:10:45,697 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 14:10:45,709 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:45,711 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:45,711 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:45,711 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:45,711 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:45,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, ASSIGN}] 2023-07-19 14:10:45,715 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, ASSIGN 2023-07-19 14:10:45,715 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, ASSIGN 2023-07-19 14:10:45,717 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1689775816952; forceNewPlan=false, retain=false 2023-07-19 14:10:45,717 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:10:45,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:45,867 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:10:45,871 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4fcbacbe4ef95c9d082a1717d5f962ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:45,871 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e283f04fb8012d59be6462a9fb278b85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:45,871 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775845871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775845871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775845871"}]},"ts":"1689775845871"} 2023-07-19 14:10:45,871 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775845871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775845871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775845871"}]},"ts":"1689775845871"} 2023-07-19 14:10:45,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 4fcbacbe4ef95c9d082a1717d5f962ad, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:10:45,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure e283f04fb8012d59be6462a9fb278b85, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:10:45,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:46,028 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,029 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:10:46,034 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:10:46,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:46,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e283f04fb8012d59be6462a9fb278b85, NAME => 'testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:10:46,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. service=AccessControlService 2023-07-19 14:10:46,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:46,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:46,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:46,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4fcbacbe4ef95c9d082a1717d5f962ad, NAME => 'testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:10:46,045 INFO [StoreOpener-e283f04fb8012d59be6462a9fb278b85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. service=AccessControlService 2023-07-19 14:10:46,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:46,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:46,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,048 INFO [StoreOpener-4fcbacbe4ef95c9d082a1717d5f962ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,048 DEBUG [StoreOpener-e283f04fb8012d59be6462a9fb278b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf 2023-07-19 14:10:46,048 DEBUG [StoreOpener-e283f04fb8012d59be6462a9fb278b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf 2023-07-19 14:10:46,048 INFO [StoreOpener-e283f04fb8012d59be6462a9fb278b85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e283f04fb8012d59be6462a9fb278b85 columnFamilyName cf 2023-07-19 14:10:46,049 DEBUG [StoreOpener-4fcbacbe4ef95c9d082a1717d5f962ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf 2023-07-19 14:10:46,049 DEBUG [StoreOpener-4fcbacbe4ef95c9d082a1717d5f962ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf 2023-07-19 14:10:46,050 INFO [StoreOpener-4fcbacbe4ef95c9d082a1717d5f962ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fcbacbe4ef95c9d082a1717d5f962ad columnFamilyName cf 2023-07-19 14:10:46,050 INFO [StoreOpener-e283f04fb8012d59be6462a9fb278b85-1] regionserver.HStore(310): Store=e283f04fb8012d59be6462a9fb278b85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:46,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,060 INFO [StoreOpener-4fcbacbe4ef95c9d082a1717d5f962ad-1] regionserver.HStore(310): Store=4fcbacbe4ef95c9d082a1717d5f962ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:46,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:10:46,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:46,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:10:46,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e283f04fb8012d59be6462a9fb278b85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58767902, jitterRate=-0.12429001927375793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:46,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e283f04fb8012d59be6462a9fb278b85: 2023-07-19 14:10:46,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85., pid=31, masterSystemTime=1689775846029 2023-07-19 14:10:46,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:46,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4fcbacbe4ef95c9d082a1717d5f962ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62145218, jitterRate=-0.07396408915519714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:46,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4fcbacbe4ef95c9d082a1717d5f962ad: 2023-07-19 14:10:46,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:46,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:46,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad., pid=30, masterSystemTime=1689775846028 2023-07-19 14:10:46,079 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e283f04fb8012d59be6462a9fb278b85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,081 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775846077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775846077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775846077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775846077"}]},"ts":"1689775846077"} 2023-07-19 14:10:46,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:46,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:46,085 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4fcbacbe4ef95c9d082a1717d5f962ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,086 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775846085"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775846085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775846085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775846085"}]},"ts":"1689775846085"} 2023-07-19 14:10:46,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 14:10:46,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure e283f04fb8012d59be6462a9fb278b85, server=jenkins-hbase4.apache.org,34233,1689775817080 in 209 msec 2023-07-19 14:10:46,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, ASSIGN in 378 msec 2023-07-19 14:10:46,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 14:10:46,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 4fcbacbe4ef95c9d082a1717d5f962ad, server=jenkins-hbase4.apache.org,42107,1689775816952 in 216 msec 2023-07-19 14:10:46,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 14:10:46,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, ASSIGN in 389 msec 2023-07-19 14:10:46,104 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:46,105 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775846104"}]},"ts":"1689775846104"} 2023-07-19 14:10:46,107 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 14:10:46,130 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:46,131 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 14:10:46,133 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:10:46,183 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:46,183 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:46,183 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:46,183 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:46,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:46,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:46,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:46,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:46,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 599 msec 2023-07-19 14:10:46,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:46,245 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 14:10:46,248 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 14:10:46,248 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:46,250 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:46,262 DEBUG [hconnection-0x448f8d1-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:46,268 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:46,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:46,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775846277 (current time:1689775846277). 2023-07-19 14:10:46,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:46,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x51d63ebf to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:46,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b83163f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:46,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:46,317 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:46,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51d63ebf to 127.0.0.1:54361 2023-07-19 14:10:46,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:46,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x60b613ce to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f5eaa1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:46,417 DEBUG [hconnection-0x6324266e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:46,420 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:46,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60b613ce to 127.0.0.1:54361 2023-07-19 14:10:46,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:46,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:10:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:46,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:46,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:46,431 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:46,433 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776446433 2023-07-19 14:10:46,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:46,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 14:10:46,434 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:46,434 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:46,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:46,436 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:46,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 14:10:46,439 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:46,440 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776446440 2023-07-19 14:10:46,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,454 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 14:10:46,454 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:46,455 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 14:10:46,455 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:10:46,476 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,476 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,498 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:46,498 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:46,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:46,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:46,498 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:46,498 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:46,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,499 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,499 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,499 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,500 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:46,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:46,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,501 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:46,501 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:46,501 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:46,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,502 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:46,502 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:46,502 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:46,503 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:46,501 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:46,503 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:46,504 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:46,505 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:46,534 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:46,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:46,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:46,536 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:46,545 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,545 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:46,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:46,660 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:46,660 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,660 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,661 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,660 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,661 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:46,661 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:46,661 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,661 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7de0755d[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:46,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:46,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:46,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7de0755d[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:46,666 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:10:46,667 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:46,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:46,707 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:46,707 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:10:46,707 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. started... 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:46,709 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4fcbacbe4ef95c9d082a1717d5f962ad: 2023-07-19 14:10:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:46,709 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,709 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:46,709 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:46,709 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:46,710 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:46,711 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:46,711 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. started... 2023-07-19 14:10:46,711 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e283f04fb8012d59be6462a9fb278b85: 2023-07-19 14:10:46,712 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,712 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:46,712 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:46,736 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:46,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:46,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:46,737 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:10:46,745 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:46,746 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:46,746 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:46,749 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. completed. 2023-07-19 14:10:46,749 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:46,749 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. completed. 2023-07-19 14:10:46,749 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:10:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:46,791 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:46,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:46,791 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:46,793 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,793 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:46,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:10:46,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:10:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:46,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:46,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42107,1689775816952': 2023-07-19 14:10:46,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:10:46,805 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 14:10:46,805 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:46,805 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:46,805 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,805 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:46,860 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,860 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,860 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:46,860 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,860 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:46,861 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:46,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,860 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:46,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,861 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:46,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:46,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,866 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:46,867 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:46,871 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,871 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,872 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:46,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:46,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:46,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:46,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 14:10:46,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:10:46,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:46,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:46,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:46,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:46,915 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:46,914 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:46,917 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:46,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:46,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:46,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:47,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 14:10:47,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:47,023 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:47,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689775846433Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689775846936 (+503 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689775846936Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689775846936Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689775846942 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689775846980 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689775847022 (+42 ms) 2023-07-19 14:10:47,026 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:47,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 592 msec 2023-07-19 14:10:47,038 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:47,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:47,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:47,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:47,053 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 14:10:47,053 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:47,054 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:47,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:47,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775847069 (current time:1689775847069). 2023-07-19 14:10:47,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:47,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x3576458f to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:47,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d47c31a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:47,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:47,113 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:47,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3576458f to 127.0.0.1:54361 2023-07-19 14:10:47,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x485778e4 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:47,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf653b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:47,248 DEBUG [hconnection-0x3ae8619-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:47,249 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:47,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x485778e4 to 127.0.0.1:54361 2023-07-19 14:10:47,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:47,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:10:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:47,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:47,261 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:47,262 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776447262 2023-07-19 14:10:47,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 14:10:47,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:47,263 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:47,263 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:47,264 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:47,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:47,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 14:10:47,267 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:47,268 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776447268 2023-07-19 14:10:47,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 14:10:47,280 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 14:10:47,280 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:47,281 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 14:10:47,281 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:10:47,281 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,281 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,298 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:47,298 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:47,298 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,298 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:47,299 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,299 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,300 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:47,301 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:47,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 14:10:47,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 14:10:47,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 14:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:47,304 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:47,302 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:47,304 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:47,304 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:47,304 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:47,304 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:47,337 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,337 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:47,352 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,352 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:47,352 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:47,352 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:47,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:47,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315a465[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:47,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:47,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:47,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:47,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3315a465[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:47,357 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:10:47,357 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,363 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:47,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:47,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:47,365 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:47,383 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,383 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,383 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:47,384 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:47,384 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. started... 2023-07-19 14:10:47,384 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:47,385 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e283f04fb8012d59be6462a9fb278b85 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 14:10:47,384 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:47,385 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:47,385 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. started... 2023-07-19 14:10:47,385 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4fcbacbe4ef95c9d082a1717d5f962ad 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 14:10:47,406 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:47,406 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:47,406 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:47,419 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071984b8bb27648648229c4fc3da52139a2b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071984b8bb27648648229c4fc3da52139a2b 2023-07-19 14:10:47,420 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307195eb285bd05634eb2b0f4eb19f274f068 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307195eb285bd05634eb2b0f4eb19f274f068 2023-07-19 14:10:47,435 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/.tmp/cf/0cdee08008854449a6b91b3f8338eb30 2023-07-19 14:10:47,439 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/.tmp/cf/51b47110fa9a4a9ebb098f8e85a6235a 2023-07-19 14:10:47,446 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/.tmp/cf/0cdee08008854449a6b91b3f8338eb30 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf/0cdee08008854449a6b91b3f8338eb30 2023-07-19 14:10:47,446 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/.tmp/cf/51b47110fa9a4a9ebb098f8e85a6235a as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf/51b47110fa9a4a9ebb098f8e85a6235a 2023-07-19 14:10:47,452 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf/0cdee08008854449a6b91b3f8338eb30, entries=44, sequenceid=6, filesize=12.3 K 2023-07-19 14:10:47,452 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf/51b47110fa9a4a9ebb098f8e85a6235a, entries=6, sequenceid=6, filesize=5.9 K 2023-07-19 14:10:47,453 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e283f04fb8012d59be6462a9fb278b85 in 69ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:47,453 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 4fcbacbe4ef95c9d082a1717d5f962ad in 68ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:47,453 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 14:10:47,453 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4fcbacbe4ef95c9d082a1717d5f962ad: 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e283f04fb8012d59be6462a9fb278b85: 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf/51b47110fa9a4a9ebb098f8e85a6235a] hfiles 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf/0cdee08008854449a6b91b3f8338eb30] hfiles 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf/0cdee08008854449a6b91b3f8338eb30 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:47,457 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf/51b47110fa9a4a9ebb098f8e85a6235a for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:47,476 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. completed. 2023-07-19 14:10:47,476 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:10:47,477 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. completed. 2023-07-19 14:10:47,477 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:47,477 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:10:47,566 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:47,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:47,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:47,567 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:10:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:47,606 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:47,637 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:47,637 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:47,637 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:47,637 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42107,1689775816952': 2023-07-19 14:10:47,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:10:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:47,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:47,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:10:47,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:10:47,646 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 14:10:47,646 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:47,646 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:47,646 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 14:10:47,646 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:47,668 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:47,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:47,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:47,669 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,669 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,671 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:47,671 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:47,672 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,698 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:47,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:47,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 14:10:47,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 14:10:47,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:47,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:10:47,699 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:47,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:47,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:47,700 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,700 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:47,700 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,702 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:10:47,702 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,702 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:10:47,702 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:10:47,702 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,702 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:47,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:47,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:47,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071984b8bb27648648229c4fc3da52139a2b, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307195eb285bd05634eb2b0f4eb19f274f068] mob files 2023-07-19 14:10:47,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071984b8bb27648648229c4fc3da52139a2b 2023-07-19 14:10:47,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307195eb285bd05634eb2b0f4eb19f274f068 2023-07-19 14:10:47,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:47,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:47,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 14:10:47,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 14:10:47,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,797 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689775847262Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689775847740 (+478 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689775847740Loading Region manifests for snaptb0-testExportFileSystemState at 1689775847741 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689775847747 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689775847761 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689775847796 (+35 ms) 2023-07-19 14:10:47,799 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:47,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 536 msec 2023-07-19 14:10:47,867 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:47,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:47,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:47,869 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869 2023-07-19 14:10:47,869 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40027, tgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869, rawTgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:47,893 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:10:47,893 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1279014796_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,893 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 14:10:47,907 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:47,929 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:47,929 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:47,930 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:47,930 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:47,930 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:47,931 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:47,931 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,005 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-5474026672604757130.jar 2023-07-19 14:10:48,006 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,006 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,007 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,007 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,007 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,008 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:48,008 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:10:48,008 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:10:48,009 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:10:48,009 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:10:48,009 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:10:48,010 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:10:48,010 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:10:48,011 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:10:48,011 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:10:48,011 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:10:48,012 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:48,012 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:48,013 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:48,013 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:48,013 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:48,014 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:48,014 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:48,445 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:10:48,447 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 14:10:48,450 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 14:10:49,380 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:49,380 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:49,386 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:50,189 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0002_000001 (auth:SIMPLE) 2023-07-19 14:10:50,909 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:10:54,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0002_000001 (auth:SIMPLE) 2023-07-19 14:10:57,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0002_000001 (auth:SIMPLE) 2023-07-19 14:11:00,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0002_000001 (auth:SIMPLE) 2023-07-19 14:11:01,641 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:01,642 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:01,650 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 14:11:01,650 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:01,651 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:01,651 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 14:11:01,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 14:11:01,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 14:11:01,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 14:11:01,653 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 14:11:01,653 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775847869/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 14:11:01,661 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 14:11:01,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 14:11:01,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:01,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 14:11:01,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775861667"}]},"ts":"1689775861667"} 2023-07-19 14:11:01,669 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 14:11:01,671 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 14:11:01,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, UNASSIGN}] 2023-07-19 14:11:01,675 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, UNASSIGN 2023-07-19 14:11:01,675 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, UNASSIGN 2023-07-19 14:11:01,676 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e283f04fb8012d59be6462a9fb278b85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:01,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4fcbacbe4ef95c9d082a1717d5f962ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:01,676 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775861676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775861676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775861676"}]},"ts":"1689775861676"} 2023-07-19 14:11:01,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775861676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775861676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775861676"}]},"ts":"1689775861676"} 2023-07-19 14:11:01,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure e283f04fb8012d59be6462a9fb278b85, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:01,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 4fcbacbe4ef95c9d082a1717d5f962ad, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:11:01,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 14:11:01,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:11:01,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e283f04fb8012d59be6462a9fb278b85, disabling compactions & flushes 2023-07-19 14:11:01,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. after waiting 0 ms 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:11:01,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4fcbacbe4ef95c9d082a1717d5f962ad, disabling compactions & flushes 2023-07-19 14:11:01,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. after waiting 0 ms 2023-07-19 14:11:01,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:11:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:01,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:01,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad. 2023-07-19 14:11:01,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:01,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4fcbacbe4ef95c9d082a1717d5f962ad: 2023-07-19 14:11:01,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85. 2023-07-19 14:11:01,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e283f04fb8012d59be6462a9fb278b85: 2023-07-19 14:11:01,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:11:01,873 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e283f04fb8012d59be6462a9fb278b85, regionState=CLOSED 2023-07-19 14:11:01,873 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775861873"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775861873"}]},"ts":"1689775861873"} 2023-07-19 14:11:01,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:11:01,875 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4fcbacbe4ef95c9d082a1717d5f962ad, regionState=CLOSED 2023-07-19 14:11:01,875 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775861875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775861875"}]},"ts":"1689775861875"} 2023-07-19 14:11:01,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-19 14:11:01,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure e283f04fb8012d59be6462a9fb278b85, server=jenkins-hbase4.apache.org,34233,1689775817080 in 198 msec 2023-07-19 14:11:01,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-19 14:11:01,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 4fcbacbe4ef95c9d082a1717d5f962ad, server=jenkins-hbase4.apache.org,42107,1689775816952 in 198 msec 2023-07-19 14:11:01,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e283f04fb8012d59be6462a9fb278b85, UNASSIGN in 207 msec 2023-07-19 14:11:01,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 14:11:01,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4fcbacbe4ef95c9d082a1717d5f962ad, UNASSIGN in 208 msec 2023-07-19 14:11:01,884 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775861884"}]},"ts":"1689775861884"} 2023-07-19 14:11:01,886 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 14:11:01,888 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 14:11:01,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 228 msec 2023-07-19 14:11:01,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 14:11:01,970 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 14:11:01,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 14:11:01,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:01,977 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:01,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 14:11:01,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:01,980 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 14:11:01,984 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,984 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,984 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:01,985 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:01,987 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 14:11:01,994 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:11:01,995 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:11:01,997 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/recovered.edits] 2023-07-19 14:11:01,998 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/recovered.edits] 2023-07-19 14:11:02,002 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf/0cdee08008854449a6b91b3f8338eb30 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/cf/0cdee08008854449a6b91b3f8338eb30 2023-07-19 14:11:02,003 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf/51b47110fa9a4a9ebb098f8e85a6235a to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/cf/51b47110fa9a4a9ebb098f8e85a6235a 2023-07-19 14:11:02,009 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85/recovered.edits/9.seqid 2023-07-19 14:11:02,010 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/e283f04fb8012d59be6462a9fb278b85 2023-07-19 14:11:02,018 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad/recovered.edits/9.seqid 2023-07-19 14:11:02,018 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemState/4fcbacbe4ef95c9d082a1717d5f962ad 2023-07-19 14:11:02,019 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 14:11:02,019 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 14:11:02,021 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-19 14:11:02,026 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071984b8bb27648648229c4fc3da52139a2b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071984b8bb27648648229c4fc3da52139a2b 2023-07-19 14:11:02,028 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307195eb285bd05634eb2b0f4eb19f274f068 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307195eb285bd05634eb2b0f4eb19f274f068 2023-07-19 14:11:02,031 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 14:11:02,035 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:02,039 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 14:11:02,041 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 14:11:02,042 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:02,042 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 14:11:02,043 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775862043"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:02,043 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775862043"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:02,049 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:11:02,049 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e283f04fb8012d59be6462a9fb278b85, NAME => 'testtb-testExportFileSystemState,,1689775845629.e283f04fb8012d59be6462a9fb278b85.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4fcbacbe4ef95c9d082a1717d5f962ad, NAME => 'testtb-testExportFileSystemState,1,1689775845629.4fcbacbe4ef95c9d082a1717d5f962ad.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:11:02,049 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 14:11:02,049 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775862049"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:02,051 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 14:11:02,053 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:02,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 81 msec 2023-07-19 14:11:02,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 14:11:02,090 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 14:11:02,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 14:11:02,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 14:11:02,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 14:11:02,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 14:11:02,145 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:59266 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:34677 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:53980 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2146 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-756350145_1 at /127.0.0.1:55118 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-756350145_1 at /127.0.0.1:47958 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:47982 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 371) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2956 (was 3145) 2023-07-19 14:11:02,146 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 14:11:02,175 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=182, AvailableMemoryMB=2955 2023-07-19 14:11:02,175 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 14:11:02,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 14:11:02,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:02,182 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:02,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 14:11:02,183 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:02,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:02,187 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,187 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,187 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e empty. 2023-07-19 14:11:02,187 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b empty. 2023-07-19 14:11:02,188 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,188 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,188 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 14:11:02,205 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:02,207 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => be795ea0ce86816698e06dac5383323e, NAME => 'testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:02,207 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1bed0cbe80b7a57efb0896fbee03599b, NAME => 'testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:02,228 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:02,228 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 1bed0cbe80b7a57efb0896fbee03599b, disabling compactions & flushes 2023-07-19 14:11:02,228 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,228 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,228 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. after waiting 0 ms 2023-07-19 14:11:02,228 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,229 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 1bed0cbe80b7a57efb0896fbee03599b: 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing be795ea0ce86816698e06dac5383323e, disabling compactions & flushes 2023-07-19 14:11:02,229 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. after waiting 0 ms 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,229 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,229 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for be795ea0ce86816698e06dac5383323e: 2023-07-19 14:11:02,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:02,233 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775862232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775862232"}]},"ts":"1689775862232"} 2023-07-19 14:11:02,233 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775862232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775862232"}]},"ts":"1689775862232"} 2023-07-19 14:11:02,235 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:02,236 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:02,237 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775862236"}]},"ts":"1689775862236"} 2023-07-19 14:11:02,238 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 14:11:02,242 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:02,243 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:02,243 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:02,243 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:02,243 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:02,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, ASSIGN}] 2023-07-19 14:11:02,246 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, ASSIGN 2023-07-19 14:11:02,246 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, ASSIGN 2023-07-19 14:11:02,247 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44997,1689775817028; forceNewPlan=false, retain=false 2023-07-19 14:11:02,247 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:11:02,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:02,397 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:02,400 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=be795ea0ce86816698e06dac5383323e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,400 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1bed0cbe80b7a57efb0896fbee03599b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,400 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775862400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775862400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775862400"}]},"ts":"1689775862400"} 2023-07-19 14:11:02,400 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775862400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775862400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775862400"}]},"ts":"1689775862400"} 2023-07-19 14:11:02,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure be795ea0ce86816698e06dac5383323e, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:02,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 1bed0cbe80b7a57efb0896fbee03599b, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:11:02,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:02,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be795ea0ce86816698e06dac5383323e, NAME => 'testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:11:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. service=AccessControlService 2023-07-19 14:11:02,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1bed0cbe80b7a57efb0896fbee03599b, NAME => 'testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:11:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. service=AccessControlService 2023-07-19 14:11:02,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,563 INFO [StoreOpener-be795ea0ce86816698e06dac5383323e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,564 INFO [StoreOpener-1bed0cbe80b7a57efb0896fbee03599b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,564 DEBUG [StoreOpener-be795ea0ce86816698e06dac5383323e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf 2023-07-19 14:11:02,564 DEBUG [StoreOpener-be795ea0ce86816698e06dac5383323e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf 2023-07-19 14:11:02,565 INFO [StoreOpener-be795ea0ce86816698e06dac5383323e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be795ea0ce86816698e06dac5383323e columnFamilyName cf 2023-07-19 14:11:02,565 DEBUG [StoreOpener-1bed0cbe80b7a57efb0896fbee03599b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf 2023-07-19 14:11:02,565 DEBUG [StoreOpener-1bed0cbe80b7a57efb0896fbee03599b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf 2023-07-19 14:11:02,565 INFO [StoreOpener-1bed0cbe80b7a57efb0896fbee03599b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bed0cbe80b7a57efb0896fbee03599b columnFamilyName cf 2023-07-19 14:11:02,566 INFO [StoreOpener-be795ea0ce86816698e06dac5383323e-1] regionserver.HStore(310): Store=be795ea0ce86816698e06dac5383323e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:02,566 INFO [StoreOpener-1bed0cbe80b7a57efb0896fbee03599b-1] regionserver.HStore(310): Store=1bed0cbe80b7a57efb0896fbee03599b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:02,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:02,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:02,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:02,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:02,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be795ea0ce86816698e06dac5383323e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62179866, jitterRate=-0.07344779372215271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:02,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be795ea0ce86816698e06dac5383323e: 2023-07-19 14:11:02,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1bed0cbe80b7a57efb0896fbee03599b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68324567, jitterRate=0.018115386366844177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:02,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1bed0cbe80b7a57efb0896fbee03599b: 2023-07-19 14:11:02,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e., pid=45, masterSystemTime=1689775862554 2023-07-19 14:11:02,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,577 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=be795ea0ce86816698e06dac5383323e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775862577"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775862577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775862577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775862577"}]},"ts":"1689775862577"} 2023-07-19 14:11:02,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b., pid=46, masterSystemTime=1689775862555 2023-07-19 14:11:02,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 14:11:02,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure be795ea0ce86816698e06dac5383323e, server=jenkins-hbase4.apache.org,34233,1689775817080 in 178 msec 2023-07-19 14:11:02,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1bed0cbe80b7a57efb0896fbee03599b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775862583"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775862583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775862583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775862583"}]},"ts":"1689775862583"} 2023-07-19 14:11:02,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, ASSIGN in 338 msec 2023-07-19 14:11:02,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 14:11:02,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 1bed0cbe80b7a57efb0896fbee03599b, server=jenkins-hbase4.apache.org,44997,1689775817028 in 183 msec 2023-07-19 14:11:02,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 14:11:02,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, ASSIGN in 344 msec 2023-07-19 14:11:02,597 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:02,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775862598"}]},"ts":"1689775862598"} 2023-07-19 14:11:02,599 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 14:11:02,602 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:02,603 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 14:11:02,605 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 14:11:02,606 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:02,606 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:02,606 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:02,606 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:02,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:02,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:02,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:02,608 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:02,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 431 msec 2023-07-19 14:11:02,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:02,788 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 14:11:02,791 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 14:11:02,791 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,793 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:02,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:02,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775862807 (current time:1689775862807). 2023-07-19 14:11:02,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:02,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x69789533 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:02,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45b79df5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:02,822 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:02,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69789533 to 127.0.0.1:54361 2023-07-19 14:11:02,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:02,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x6374fb8a to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:02,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e083bda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:02,832 DEBUG [hconnection-0x37a95fdb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:02,834 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:02,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6374fb8a to 127.0.0.1:54361 2023-07-19 14:11:02,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:02,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 14:11:02,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:02,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:02,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:02,845 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:02,846 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689776462846 2023-07-19 14:11:02,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:02,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 14:11:02,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:02,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:02,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:02,850 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:02,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-19 14:11:02,852 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:02,853 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689776462853 2023-07-19 14:11:02,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,867 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 14:11:02,867 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:02,869 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 14:11:02,869 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 14:11:02,869 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,869 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,872 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,872 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,872 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,872 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,872 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,873 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,873 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,873 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 14:11:02,874 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 14:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,874 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:02,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:02,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:02,875 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:02,876 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:02,876 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:02,879 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:02,880 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:02,880 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:02,880 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:02,881 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,882 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,882 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,882 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,883 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56dc5420[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:02,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56dc5420[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:02,886 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 14:11:02,886 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:02,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:02,888 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,888 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,888 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. started... 2023-07-19 14:11:02,888 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,888 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:02,888 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. started... 2023-07-19 14:11:02,888 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,889 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1bed0cbe80b7a57efb0896fbee03599b: 2023-07-19 14:11:02,889 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:02,890 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:02,889 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be795ea0ce86816698e06dac5383323e: 2023-07-19 14:11:02,890 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:11:02,890 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,890 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,890 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:02,890 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:02,891 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:02,891 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:02,897 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:02,897 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,897 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:02,903 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. completed. 2023-07-19 14:11:02,903 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:02,903 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. completed. 2023-07-19 14:11:02,903 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:02,903 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:02,903 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,903 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:02,904 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:11:02,905 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,905 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,906 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:02,906 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,906 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:02,906 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:02,906 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,906 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:11:02,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 14:11:02,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44997,1689775817028': 2023-07-19 14:11:02,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 14:11:02,916 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 14:11:02,916 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:02,916 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:02,916 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,916 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,918 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,919 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,920 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,921 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,923 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,924 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,924 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,928 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,929 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 14:11:02,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:11:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,929 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,931 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,931 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,931 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:02,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 14:11:02,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,931 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:02,932 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,932 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,947 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:02,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:02,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:02,948 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:02,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 14:11:02,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,980 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:02,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689775862846Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689775862944 (+98 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689775862944Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689775862944Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689775862949 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689775862957 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689775862980 (+23 ms) 2023-07-19 14:11:02,983 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:02,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 136 msec 2023-07-19 14:11:03,148 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:03,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:03,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:03,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:03,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44997] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:03,157 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 14:11:03,157 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:03,157 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:03,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:03,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775863168 (current time:1689775863168). 2023-07-19 14:11:03,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:03,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x5c06ac31 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:03,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49686152, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:03,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:03,184 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:03,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c06ac31 to 127.0.0.1:54361 2023-07-19 14:11:03,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x627b299d to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:03,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7576c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:03,194 DEBUG [hconnection-0x11df40a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:03,196 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627b299d to 127.0.0.1:54361 2023-07-19 14:11:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 14:11:03,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:03,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:03,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:03,205 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:03,206 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689776463206 2023-07-19 14:11:03,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:03,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 14:11:03,207 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:03,207 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:03,208 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:03,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:03,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-19 14:11:03,211 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:03,211 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689776463211 2023-07-19 14:11:03,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 14:11:03,226 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 14:11:03,226 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:03,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 14:11:03,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 14:11:03,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,230 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:03,230 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:03,230 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:03,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:03,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:03,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:03,230 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,231 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,231 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,231 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,231 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:03,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:03,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 14:11:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:03,233 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:03,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 14:11:03,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 14:11:03,238 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:03,239 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:03,240 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:03,242 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:03,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,243 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:03,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:03,245 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,245 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,245 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,245 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:03,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:03,245 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,245 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:03,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,247 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,247 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,247 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:03,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24315b7b[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:03,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:03,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:03,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:03,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24315b7b[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:03,251 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 14:11:03,251 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,254 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,254 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,254 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:03,255 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:03,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:03,255 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:03,255 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:03,255 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. started... 2023-07-19 14:11:03,256 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1bed0cbe80b7a57efb0896fbee03599b 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 14:11:03,256 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,256 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:03,270 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:03,271 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. started... 2023-07-19 14:11:03,271 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2745): Flushing be795ea0ce86816698e06dac5383323e 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 14:11:03,307 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:03,314 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307191ebe1c98277d4b65b9b10165d5b14b41 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307191ebe1c98277d4b65b9b10165d5b14b41 2023-07-19 14:11:03,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:03,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:03,320 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:03,338 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719f18716c0962148cebabcaf3d91e3b51b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719f18716c0962148cebabcaf3d91e3b51b 2023-07-19 14:11:03,342 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/.tmp/cf/5785d7fa6e044ba6b33a704bff20471d 2023-07-19 14:11:03,349 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/.tmp/cf/5785d7fa6e044ba6b33a704bff20471d as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf/5785d7fa6e044ba6b33a704bff20471d 2023-07-19 14:11:03,355 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf/5785d7fa6e044ba6b33a704bff20471d, entries=44, sequenceid=6, filesize=12.2 K 2023-07-19 14:11:03,356 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 1bed0cbe80b7a57efb0896fbee03599b in 100ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:03,357 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 14:11:03,357 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1bed0cbe80b7a57efb0896fbee03599b: 2023-07-19 14:11:03,357 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:03,358 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:03,358 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf/5785d7fa6e044ba6b33a704bff20471d] hfiles 2023-07-19 14:11:03,358 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf/5785d7fa6e044ba6b33a704bff20471d for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:03,400 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/.tmp/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89 2023-07-19 14:11:03,416 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. completed. 2023-07-19 14:11:03,416 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:03,416 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:03,416 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:03,416 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,416 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:03,416 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:11:03,419 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,419 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:03,419 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:03,419 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:03,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:03,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,423 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/.tmp/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89 2023-07-19 14:11:03,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:03,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44997,1689775817028': 2023-07-19 14:11:03,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 14:11:03,434 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89, entries=6, sequenceid=6, filesize=5.9 K 2023-07-19 14:11:03,436 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for be795ea0ce86816698e06dac5383323e in 165ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:03,438 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be795ea0ce86816698e06dac5383323e: 2023-07-19 14:11:03,438 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:03,439 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:03,439 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89] hfiles 2023-07-19 14:11:03,439 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:03,459 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. completed. 2023-07-19 14:11:03,459 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:03,459 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:03,459 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:03,459 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,459 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:03,459 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:11:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:03,461 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:11:03,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 14:11:03,469 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 14:11:03,469 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:03,469 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:03,469 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 14:11:03,469 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:03,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,472 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:03,473 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:03,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:03,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,473 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:03,475 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:03,476 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:03,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,477 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,477 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:03,490 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:03,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 14:11:03,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 14:11:03,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:03,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:11:03,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:03,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:03,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,490 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:03,493 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:03,493 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,493 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:03,493 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:03,493 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,494 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307191ebe1c98277d4b65b9b10165d5b14b41, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719f18716c0962148cebabcaf3d91e3b51b] mob files 2023-07-19 14:11:03,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307191ebe1c98277d4b65b9b10165d5b14b41 2023-07-19 14:11:03,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719f18716c0962148cebabcaf3d91e3b51b 2023-07-19 14:11:03,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:03,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:03,494 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:03,494 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:03,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:03,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:03,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:03,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:03,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:03,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:03,520 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:03,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:03,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:03,522 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:03,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 14:11:03,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 14:11:03,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,614 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689775863206Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689775863533 (+327 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689775863533Loading Region manifests for snaptb0-testConsecutiveExports at 1689775863534 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689775863543 (+9 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689775863568 (+25 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689775863614 (+46 ms) 2023-07-19 14:11:03,617 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:03,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 410 msec 2023-07-19 14:11:03,823 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:03,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:03,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:03,824 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824 2023-07-19 14:11:03,824 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:11:03,846 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:11:03,846 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@134d43bd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,846 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 14:11:03,855 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:03,866 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,866 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,867 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,867 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,867 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,868 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,868 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,942 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-8888696082704443893.jar 2023-07-19 14:11:03,942 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,943 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,943 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,944 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,944 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,944 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:03,945 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:03,945 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:03,946 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:03,946 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:03,947 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:03,947 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:03,948 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:03,948 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:03,948 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:03,949 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:03,949 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:03,950 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:03,950 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:03,950 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:03,950 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:03,951 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:03,951 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:04,338 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:04,341 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 14:11:04,343 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 14:11:06,707 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:06,707 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:06,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0002_000001 (auth:SIMPLE) 2023-07-19 14:11:07,394 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:07,453 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:11:11,812 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:14,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:16,732 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:18,522 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:18,522 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:18,527 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 14:11:18,527 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:18,527 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:18,527 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5dc50ffc in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:18,530 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:18,531 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:11:18,553 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:11:18,553 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@fc8f8e6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:18,553 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 14:11:18,565 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:18,576 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,577 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,577 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,578 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,578 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,578 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,578 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,646 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-339091799141780686.jar 2023-07-19 14:11:18,647 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,647 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,647 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,648 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,648 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,648 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:18,649 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:18,649 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:18,649 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:18,650 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:18,650 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:18,651 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:18,651 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:18,651 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:18,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:18,652 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:18,653 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:18,653 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:18,653 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:18,654 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:18,655 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:19,030 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:19,032 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 14:11:19,034 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 14:11:22,923 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:22,923 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:22,925 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:23,731 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:28,161 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:30,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:33,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:35,284 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:35,284 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:35,296 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 14:11:35,296 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:35,296 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:35,296 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:35,300 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:35,300 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:35,300 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5dc50ffc in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:35,301 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:35,301 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/local-export-1689775863824/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:35,319 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 14:11:35,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 14:11:35,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,331 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775895331"}]},"ts":"1689775895331"} 2023-07-19 14:11:35,333 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 14:11:35,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 14:11:35,335 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 14:11:35,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, UNASSIGN}] 2023-07-19 14:11:35,339 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, UNASSIGN 2023-07-19 14:11:35,339 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, UNASSIGN 2023-07-19 14:11:35,340 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1bed0cbe80b7a57efb0896fbee03599b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:35,340 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775895340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775895340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775895340"}]},"ts":"1689775895340"} 2023-07-19 14:11:35,340 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=be795ea0ce86816698e06dac5383323e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:35,340 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775895340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775895340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775895340"}]},"ts":"1689775895340"} 2023-07-19 14:11:35,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 1bed0cbe80b7a57efb0896fbee03599b, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:11:35,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure be795ea0ce86816698e06dac5383323e, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:35,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 14:11:35,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:35,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1bed0cbe80b7a57efb0896fbee03599b, disabling compactions & flushes 2023-07-19 14:11:35,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:35,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:35,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. after waiting 0 ms 2023-07-19 14:11:35,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:35,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:35,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be795ea0ce86816698e06dac5383323e, disabling compactions & flushes 2023-07-19 14:11:35,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:35,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:35,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. after waiting 0 ms 2023-07-19 14:11:35,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:35,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:35,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:35,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:35,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b. 2023-07-19 14:11:35,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1bed0cbe80b7a57efb0896fbee03599b: 2023-07-19 14:11:35,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:35,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e. 2023-07-19 14:11:35,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be795ea0ce86816698e06dac5383323e: 2023-07-19 14:11:35,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:35,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:35,541 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1bed0cbe80b7a57efb0896fbee03599b, regionState=CLOSED 2023-07-19 14:11:35,541 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775895541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775895541"}]},"ts":"1689775895541"} 2023-07-19 14:11:35,548 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=be795ea0ce86816698e06dac5383323e, regionState=CLOSED 2023-07-19 14:11:35,548 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775895548"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775895548"}]},"ts":"1689775895548"} 2023-07-19 14:11:35,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 14:11:35,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 1bed0cbe80b7a57efb0896fbee03599b, server=jenkins-hbase4.apache.org,44997,1689775817028 in 205 msec 2023-07-19 14:11:35,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1bed0cbe80b7a57efb0896fbee03599b, UNASSIGN in 214 msec 2023-07-19 14:11:35,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 14:11:35,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure be795ea0ce86816698e06dac5383323e, server=jenkins-hbase4.apache.org,34233,1689775817080 in 207 msec 2023-07-19 14:11:35,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-19 14:11:35,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be795ea0ce86816698e06dac5383323e, UNASSIGN in 217 msec 2023-07-19 14:11:35,556 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775895555"}]},"ts":"1689775895555"} 2023-07-19 14:11:35,558 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 14:11:35,567 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 14:11:35,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 248 msec 2023-07-19 14:11:35,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 14:11:35,637 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 14:11:35,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 14:11:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,642 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 14:11:35,643 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,648 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 14:11:35,651 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,651 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,651 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:35,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:35,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:35,652 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:35,652 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:35,653 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,653 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:35,654 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/recovered.edits] 2023-07-19 14:11:35,654 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/recovered.edits] 2023-07-19 14:11:35,655 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,655 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,655 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:35,655 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:35,655 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,656 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:35,655 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:35,656 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:35,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 14:11:35,660 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/cf/8b4ca49d4e6244e0b3e5ab2b43df0e89 2023-07-19 14:11:35,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf/5785d7fa6e044ba6b33a704bff20471d to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/cf/5785d7fa6e044ba6b33a704bff20471d 2023-07-19 14:11:35,665 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e/recovered.edits/9.seqid 2023-07-19 14:11:35,666 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/be795ea0ce86816698e06dac5383323e 2023-07-19 14:11:35,666 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b/recovered.edits/9.seqid 2023-07-19 14:11:35,667 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testConsecutiveExports/1bed0cbe80b7a57efb0896fbee03599b 2023-07-19 14:11:35,667 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 14:11:35,667 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 14:11:35,668 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-19 14:11:35,673 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307191ebe1c98277d4b65b9b10165d5b14b41 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307191ebe1c98277d4b65b9b10165d5b14b41 2023-07-19 14:11:35,674 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719f18716c0962148cebabcaf3d91e3b51b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230719f18716c0962148cebabcaf3d91e3b51b 2023-07-19 14:11:35,675 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 14:11:35,678 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,680 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 14:11:35,682 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 14:11:35,684 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,684 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 14:11:35,684 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775895684"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:35,684 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775895684"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:35,686 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:11:35,686 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => be795ea0ce86816698e06dac5383323e, NAME => 'testtb-testConsecutiveExports,,1689775862177.be795ea0ce86816698e06dac5383323e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1bed0cbe80b7a57efb0896fbee03599b, NAME => 'testtb-testConsecutiveExports,1,1689775862177.1bed0cbe80b7a57efb0896fbee03599b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:11:35,686 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 14:11:35,686 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775895686"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:35,688 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 14:11:35,690 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:35,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 52 msec 2023-07-19 14:11:35,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 14:11:35,758 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 14:11:35,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 14:11:35,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:35,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 14:11:35,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 14:11:35,812 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 762), OpenFileDescriptor=896 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=412 (was 476), ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=3029 (was 2955) - AvailableMemoryMB LEAK? - 2023-07-19 14:11:35,812 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-19 14:11:35,837 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=412, ProcessCount=184, AvailableMemoryMB=3027 2023-07-19 14:11:35,837 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-19 14:11:35,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 14:11:35,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,843 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:35,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 14:11:35,844 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:35,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:35,847 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:35,847 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:35,848 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 empty. 2023-07-19 14:11:35,848 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 empty. 2023-07-19 14:11:35,848 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:35,849 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:35,849 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 14:11:35,899 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:35,908 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 96714c5e8ffeb2c437ae6f80db08fc30, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:35,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a8ae79e0e0844d257ba126c9c3b8ef46, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:35,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:35,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:35,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a8ae79e0e0844d257ba126c9c3b8ef46, disabling compactions & flushes 2023-07-19 14:11:35,975 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:35,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:35,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. after waiting 0 ms 2023-07-19 14:11:35,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:35,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a8ae79e0e0844d257ba126c9c3b8ef46: 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 96714c5e8ffeb2c437ae6f80db08fc30, disabling compactions & flushes 2023-07-19 14:11:35,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. after waiting 0 ms 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:35,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:35,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 96714c5e8ffeb2c437ae6f80db08fc30: 2023-07-19 14:11:35,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:35,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775895980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775895980"}]},"ts":"1689775895980"} 2023-07-19 14:11:35,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775895980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775895980"}]},"ts":"1689775895980"} 2023-07-19 14:11:35,987 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:35,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:35,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775895988"}]},"ts":"1689775895988"} 2023-07-19 14:11:35,989 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 14:11:35,993 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:35,994 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:35,994 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:35,994 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:35,995 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:35,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, ASSIGN}] 2023-07-19 14:11:35,999 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, ASSIGN 2023-07-19 14:11:35,999 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, ASSIGN 2023-07-19 14:11:36,004 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:11:36,005 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44997,1689775817028; forceNewPlan=false, retain=false 2023-07-19 14:11:36,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:36,155 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:36,158 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=96714c5e8ffeb2c437ae6f80db08fc30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,158 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a8ae79e0e0844d257ba126c9c3b8ef46, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,159 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775896158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775896158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775896158"}]},"ts":"1689775896158"} 2023-07-19 14:11:36,159 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775896158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775896158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775896158"}]},"ts":"1689775896158"} 2023-07-19 14:11:36,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 96714c5e8ffeb2c437ae6f80db08fc30, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:36,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure a8ae79e0e0844d257ba126c9c3b8ef46, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:11:36,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:36,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 96714c5e8ffeb2c437ae6f80db08fc30, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:11:36,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. service=AccessControlService 2023-07-19 14:11:36,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:36,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:36,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:36,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8ae79e0e0844d257ba126c9c3b8ef46, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:11:36,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. service=AccessControlService 2023-07-19 14:11:36,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:36,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:36,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,325 INFO [StoreOpener-96714c5e8ffeb2c437ae6f80db08fc30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,327 INFO [StoreOpener-a8ae79e0e0844d257ba126c9c3b8ef46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,328 DEBUG [StoreOpener-96714c5e8ffeb2c437ae6f80db08fc30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf 2023-07-19 14:11:36,328 DEBUG [StoreOpener-96714c5e8ffeb2c437ae6f80db08fc30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf 2023-07-19 14:11:36,331 DEBUG [StoreOpener-a8ae79e0e0844d257ba126c9c3b8ef46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf 2023-07-19 14:11:36,331 DEBUG [StoreOpener-a8ae79e0e0844d257ba126c9c3b8ef46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf 2023-07-19 14:11:36,334 INFO [StoreOpener-a8ae79e0e0844d257ba126c9c3b8ef46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8ae79e0e0844d257ba126c9c3b8ef46 columnFamilyName cf 2023-07-19 14:11:36,335 INFO [StoreOpener-a8ae79e0e0844d257ba126c9c3b8ef46-1] regionserver.HStore(310): Store=a8ae79e0e0844d257ba126c9c3b8ef46/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:36,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,339 INFO [StoreOpener-96714c5e8ffeb2c437ae6f80db08fc30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96714c5e8ffeb2c437ae6f80db08fc30 columnFamilyName cf 2023-07-19 14:11:36,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:36,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:36,350 INFO [StoreOpener-96714c5e8ffeb2c437ae6f80db08fc30-1] regionserver.HStore(310): Store=96714c5e8ffeb2c437ae6f80db08fc30/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:36,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a8ae79e0e0844d257ba126c9c3b8ef46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60314853, jitterRate=-0.10123865306377411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:36,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a8ae79e0e0844d257ba126c9c3b8ef46: 2023-07-19 14:11:36,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46., pid=61, masterSystemTime=1689775896318 2023-07-19 14:11:36,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:36,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:36,356 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a8ae79e0e0844d257ba126c9c3b8ef46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,356 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775896356"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775896356"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775896356"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775896356"}]},"ts":"1689775896356"} 2023-07-19 14:11:36,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:36,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 14:11:36,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure a8ae79e0e0844d257ba126c9c3b8ef46, server=jenkins-hbase4.apache.org,44997,1689775817028 in 193 msec 2023-07-19 14:11:36,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, ASSIGN in 367 msec 2023-07-19 14:11:36,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:36,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 96714c5e8ffeb2c437ae6f80db08fc30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63801139, jitterRate=-0.04928894340991974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:36,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 96714c5e8ffeb2c437ae6f80db08fc30: 2023-07-19 14:11:36,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30., pid=60, masterSystemTime=1689775896317 2023-07-19 14:11:36,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:36,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:36,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=96714c5e8ffeb2c437ae6f80db08fc30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775896372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775896372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775896372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775896372"}]},"ts":"1689775896372"} 2023-07-19 14:11:36,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 14:11:36,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 96714c5e8ffeb2c437ae6f80db08fc30, server=jenkins-hbase4.apache.org,34233,1689775817080 in 210 msec 2023-07-19 14:11:36,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-19 14:11:36,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, ASSIGN in 382 msec 2023-07-19 14:11:36,384 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:36,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775896384"}]},"ts":"1689775896384"} 2023-07-19 14:11:36,385 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 14:11:36,388 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:36,388 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 14:11:36,390 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 14:11:36,392 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,392 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,392 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,392 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,402 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 561 msec 2023-07-19 14:11:36,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:36,451 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 14:11:36,459 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,459 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:36,461 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:36,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:36,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775896534 (current time:1689775896534). 2023-07-19 14:11:36,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:36,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x3f21ae15 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@341395db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:36,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:36,555 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:36,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f21ae15 to 127.0.0.1:54361 2023-07-19 14:11:36,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:36,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x2c2388dd to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:36,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e40da4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:36,569 DEBUG [hconnection-0x36d52914-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:36,570 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:36,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c2388dd to 127.0.0.1:54361 2023-07-19 14:11:36,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:36,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 14:11:36,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:36,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:36,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:36,607 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:36,608 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689776496608 2023-07-19 14:11:36,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:36,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,609 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:36,609 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:36,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:36,617 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:36,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-19 14:11:36,620 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:36,621 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689776496621 2023-07-19 14:11:36,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,646 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:36,647 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:36,648 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 14:11:36,648 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 14:11:36,705 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,705 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,707 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:36,707 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:36,707 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:36,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:36,707 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:36,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,708 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,708 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,709 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,709 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 14:11:36,709 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:36,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,711 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:36,711 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:36,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:36,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:36,711 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:36,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,715 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:36,715 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:36,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:36,720 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:36,721 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:36,725 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:36,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:36,727 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,727 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:36,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:36,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05983d[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:36,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:36,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:36,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05983d[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:36,731 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 14:11:36,731 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:36,734 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:36,735 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:36,735 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,735 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:36,735 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. started... 2023-07-19 14:11:36,735 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:36,735 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. started... 2023-07-19 14:11:36,736 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96714c5e8ffeb2c437ae6f80db08fc30: 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a8ae79e0e0844d257ba126c9c3b8ef46: 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:36,737 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:36,744 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:36,744 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:36,744 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:36,809 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. completed. 2023-07-19 14:11:36,809 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:36,809 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:36,809 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:36,809 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:36,810 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:11:36,813 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. completed. 2023-07-19 14:11:36,813 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:11:36,814 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:36,816 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:36,816 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:36,816 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:36,817 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:36,818 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:36,818 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:36,819 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:36,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:11:36,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 14:11:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44997,1689775817028': 2023-07-19 14:11:36,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 14:11:36,834 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 14:11:36,834 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:36,834 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:36,834 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,834 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:36,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:36,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:36,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:36,840 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,841 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:36,841 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:36,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,846 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,847 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,848 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:36,854 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:36,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:36,855 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:36,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:11:36,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:36,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:36,855 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,856 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:36,854 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:36,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:36,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 14:11:36,856 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:36,855 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:36,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:36,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:36,858 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:36,858 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:36,858 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,858 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:36,912 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:36,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:36,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:36,914 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:36,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:36,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 14:11:37,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,177 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689775896609Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689775896952 (+343 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775896952Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775896952Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775896958 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775897066 (+108 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689775897176 (+110 ms) 2023-07-19 14:11:37,180 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:37,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 569 msec 2023-07-19 14:11:37,214 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:37,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:37,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:37,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:37,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44997] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:37,232 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,232 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:37,232 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:37,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:37,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775897246 (current time:1689775897246). 2023-07-19 14:11:37,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:37,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x4945e0c8 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:37,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@704b7baf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:37,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:37,275 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:37,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4945e0c8 to 127.0.0.1:54361 2023-07-19 14:11:37,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:37,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x3881245d to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:37,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea4c025, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:37,290 DEBUG [hconnection-0x75195e5d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:37,294 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:37,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3881245d to 127.0.0.1:54361 2023-07-19 14:11:37,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:37,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 14:11:37,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:37,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:37,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:37,310 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:37,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:37,312 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:37,312 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:37,313 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:37,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:37,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 14:11:37,328 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:37,329 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689776497329 2023-07-19 14:11:37,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,384 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:37,384 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:37,386 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 14:11:37,386 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 14:11:37,409 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,410 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,411 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,411 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:37,411 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:37,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:37,411 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:37,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:37,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:37,412 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,412 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,413 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:37,413 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,413 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:37,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 14:11:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:37,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:37,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:37,414 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 14:11:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 14:11:37,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:37,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,416 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:37,416 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:37,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:37,419 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:37,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:37,423 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:37,426 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:37,428 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,428 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:37,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:37,429 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,430 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,430 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,431 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,430 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,431 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:37,431 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:37,431 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,431 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:37,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:37,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442d3994[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:37,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:37,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442d3994[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:37,439 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 14:11:37,439 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,440 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,440 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:37,441 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:37,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:11:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:37,441 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:37,441 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:37,442 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:37,442 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. started... 2023-07-19 14:11:37,442 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:37,442 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:37,442 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,442 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:37,442 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a8ae79e0e0844d257ba126c9c3b8ef46 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 14:11:37,442 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. started... 2023-07-19 14:11:37,443 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 96714c5e8ffeb2c437ae6f80db08fc30 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 14:11:37,443 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:37,443 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:37,443 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:37,496 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307196c313b0e677a463795bb9eb2a698eb27 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307196c313b0e677a463795bb9eb2a698eb27 2023-07-19 14:11:37,508 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071939ad21f986ea4306b85f704f18db97ff to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071939ad21f986ea4306b85f704f18db97ff 2023-07-19 14:11:37,513 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/.tmp/cf/279f98c010614b4ab875d5cf03e965f3 2023-07-19 14:11:37,522 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/.tmp/cf/279f98c010614b4ab875d5cf03e965f3 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf/279f98c010614b4ab875d5cf03e965f3 2023-07-19 14:11:37,529 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/.tmp/cf/3ee63368ec4b4c339386c1429805eb4c 2023-07-19 14:11:37,532 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf/279f98c010614b4ab875d5cf03e965f3, entries=47, sequenceid=6, filesize=13.5 K 2023-07-19 14:11:37,543 INFO [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a8ae79e0e0844d257ba126c9c3b8ef46 in 101ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:37,543 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:37,544 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a8ae79e0e0844d257ba126c9c3b8ef46: 2023-07-19 14:11:37,544 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,544 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:37,544 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf/279f98c010614b4ab875d5cf03e965f3] hfiles 2023-07-19 14:11:37,544 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf/279f98c010614b4ab875d5cf03e965f3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,554 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/.tmp/cf/3ee63368ec4b4c339386c1429805eb4c as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf/3ee63368ec4b4c339386c1429805eb4c 2023-07-19 14:11:37,568 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf/3ee63368ec4b4c339386c1429805eb4c, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 14:11:37,573 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 96714c5e8ffeb2c437ae6f80db08fc30 in 130ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:37,575 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96714c5e8ffeb2c437ae6f80db08fc30: 2023-07-19 14:11:37,576 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,576 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:37,576 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf/3ee63368ec4b4c339386c1429805eb4c] hfiles 2023-07-19 14:11:37,576 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf/3ee63368ec4b4c339386c1429805eb4c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,614 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:37,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:37,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:37,620 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:37,656 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. completed. 2023-07-19 14:11:37,656 DEBUG [rs(jenkins-hbase4.apache.org,44997,1689775817028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:37,657 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:11:37,658 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. completed. 2023-07-19 14:11:37,659 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:37,659 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:37,661 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:37,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:37,666 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:37,666 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,666 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:37,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:37,666 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:37,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:37,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44997,1689775817028': 2023-07-19 14:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 14:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:37,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:11:37,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 14:11:37,683 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 14:11:37,683 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:37,683 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:37,683 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,683 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:37,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:37,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:37,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:37,691 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:37,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,692 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,692 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:37,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,695 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:37,695 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,696 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,701 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:37,701 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:37,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:37,701 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:37,701 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:37,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,701 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-19 14:11:37,703 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:37,703 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:37,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:37,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,703 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:37,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:37,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:37,703 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:37,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:37,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:11:37,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:37,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:37,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:37,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307196c313b0e677a463795bb9eb2a698eb27, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071939ad21f986ea4306b85f704f18db97ff] mob files 2023-07-19 14:11:37,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307196c313b0e677a463795bb9eb2a698eb27 2023-07-19 14:11:37,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071939ad21f986ea4306b85f704f18db97ff 2023-07-19 14:11:37,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 14:11:37,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,855 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:37,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689775897312Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689775897747 (+435 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689775897747Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689775897747Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689775897761 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689775897793 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689775897854 (+61 ms) 2023-07-19 14:11:37,857 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:37,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 546 msec 2023-07-19 14:11:37,921 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:37,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:37,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:37,958 DEBUG [Listener at jenkins-hbase4.apache.org/37607] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:11:37,967 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:11:37,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 14:11:37,969 DEBUG [Listener at jenkins-hbase4.apache.org/37607] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:11:37,972 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:11:37,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 14:11:37,973 DEBUG [Listener at jenkins-hbase4.apache.org/37607] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:11:37,977 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:11:37,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44997] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 14:11:37,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:11:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:37,983 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:37,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 14:11:37,988 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:37,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:38,013 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,013 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,014 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 empty. 2023-07-19 14:11:38,015 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 empty. 2023-07-19 14:11:38,015 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,018 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 14:11:38,055 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:38,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 181adeab01e97d9f765e965be8d384f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:38,063 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 01ff527b17d107f157e480afe9238e15, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:38,087 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:38,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 181adeab01e97d9f765e965be8d384f0, disabling compactions & flushes 2023-07-19 14:11:38,088 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. after waiting 0 ms 2023-07-19 14:11:38,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,088 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,088 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 181adeab01e97d9f765e965be8d384f0: 2023-07-19 14:11:38,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:38,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 01ff527b17d107f157e480afe9238e15, disabling compactions & flushes 2023-07-19 14:11:38,089 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. after waiting 0 ms 2023-07-19 14:11:38,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,089 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,089 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 01ff527b17d107f157e480afe9238e15: 2023-07-19 14:11:38,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:38,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:38,093 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775898093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775898093"}]},"ts":"1689775898093"} 2023-07-19 14:11:38,093 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775898093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775898093"}]},"ts":"1689775898093"} 2023-07-19 14:11:38,095 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:38,096 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:38,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775898096"}]},"ts":"1689775898096"} 2023-07-19 14:11:38,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 14:11:38,176 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:38,178 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:38,178 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:38,178 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:38,178 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:38,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, ASSIGN}] 2023-07-19 14:11:38,182 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, ASSIGN 2023-07-19 14:11:38,182 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, ASSIGN 2023-07-19 14:11:38,183 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1689775816952; forceNewPlan=false, retain=false 2023-07-19 14:11:38,183 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:11:38,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:38,333 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:38,336 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=181adeab01e97d9f765e965be8d384f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:38,336 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=01ff527b17d107f157e480afe9238e15, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:38,337 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775898336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775898336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775898336"}]},"ts":"1689775898336"} 2023-07-19 14:11:38,337 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775898336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775898336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775898336"}]},"ts":"1689775898336"} 2023-07-19 14:11:38,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 181adeab01e97d9f765e965be8d384f0, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:38,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 01ff527b17d107f157e480afe9238e15, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:11:38,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 181adeab01e97d9f765e965be8d384f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 14:11:38,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. service=AccessControlService 2023-07-19 14:11:38,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:38,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:38,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01ff527b17d107f157e480afe9238e15, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 14:11:38,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. service=AccessControlService 2023-07-19 14:11:38,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:38,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:38,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,503 INFO [StoreOpener-181adeab01e97d9f765e965be8d384f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,505 DEBUG [StoreOpener-181adeab01e97d9f765e965be8d384f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf 2023-07-19 14:11:38,505 DEBUG [StoreOpener-181adeab01e97d9f765e965be8d384f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf 2023-07-19 14:11:38,505 INFO [StoreOpener-181adeab01e97d9f765e965be8d384f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 181adeab01e97d9f765e965be8d384f0 columnFamilyName cf 2023-07-19 14:11:38,507 INFO [StoreOpener-01ff527b17d107f157e480afe9238e15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,508 DEBUG [StoreOpener-01ff527b17d107f157e480afe9238e15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf 2023-07-19 14:11:38,508 DEBUG [StoreOpener-01ff527b17d107f157e480afe9238e15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf 2023-07-19 14:11:38,509 INFO [StoreOpener-01ff527b17d107f157e480afe9238e15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01ff527b17d107f157e480afe9238e15 columnFamilyName cf 2023-07-19 14:11:38,509 INFO [StoreOpener-01ff527b17d107f157e480afe9238e15-1] regionserver.HStore(310): Store=01ff527b17d107f157e480afe9238e15/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:38,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,510 INFO [StoreOpener-181adeab01e97d9f765e965be8d384f0-1] regionserver.HStore(310): Store=181adeab01e97d9f765e965be8d384f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:38,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:38,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:38,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01ff527b17d107f157e480afe9238e15; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59925331, jitterRate=-0.10704298317432404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:38,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01ff527b17d107f157e480afe9238e15: 2023-07-19 14:11:38,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 181adeab01e97d9f765e965be8d384f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73860942, jitterRate=0.1006138026714325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:38,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 181adeab01e97d9f765e965be8d384f0: 2023-07-19 14:11:38,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15., pid=70, masterSystemTime=1689775898494 2023-07-19 14:11:38,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0., pid=69, masterSystemTime=1689775898492 2023-07-19 14:11:38,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:38,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=01ff527b17d107f157e480afe9238e15, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:38,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775898519"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775898519"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775898519"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775898519"}]},"ts":"1689775898519"} 2023-07-19 14:11:38,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:38,520 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=181adeab01e97d9f765e965be8d384f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:38,520 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775898520"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775898520"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775898520"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775898520"}]},"ts":"1689775898520"} 2023-07-19 14:11:38,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 14:11:38,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 01ff527b17d107f157e480afe9238e15, server=jenkins-hbase4.apache.org,42107,1689775816952 in 180 msec 2023-07-19 14:11:38,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 14:11:38,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 181adeab01e97d9f765e965be8d384f0, server=jenkins-hbase4.apache.org,34233,1689775817080 in 182 msec 2023-07-19 14:11:38,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, ASSIGN in 344 msec 2023-07-19 14:11:38,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-19 14:11:38,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, ASSIGN in 344 msec 2023-07-19 14:11:38,526 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:38,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775898526"}]},"ts":"1689775898526"} 2023-07-19 14:11:38,527 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 14:11:38,562 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:38,562 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 14:11:38,564 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 14:11:38,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:38,599 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:38,599 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:38,599 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:38,599 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:38,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:38,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 666 msec 2023-07-19 14:11:39,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:39,096 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 14:11:39,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 181adeab01e97d9f765e965be8d384f0, 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:39,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[181adeab01e97d9f765e965be8d384f0, 01ff527b17d107f157e480afe9238e15], force=true 2023-07-19 14:11:39,131 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[181adeab01e97d9f765e965be8d384f0, 01ff527b17d107f157e480afe9238e15], force=true 2023-07-19 14:11:39,131 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[181adeab01e97d9f765e965be8d384f0, 01ff527b17d107f157e480afe9238e15], force=true 2023-07-19 14:11:39,131 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[181adeab01e97d9f765e965be8d384f0, 01ff527b17d107f157e480afe9238e15], force=true 2023-07-19 14:11:39,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:39,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, UNASSIGN}] 2023-07-19 14:11:39,161 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, UNASSIGN 2023-07-19 14:11:39,162 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, UNASSIGN 2023-07-19 14:11:39,163 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=01ff527b17d107f157e480afe9238e15, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:39,163 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=181adeab01e97d9f765e965be8d384f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:39,163 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775899162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775899162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775899162"}]},"ts":"1689775899162"} 2023-07-19 14:11:39,163 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775899162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775899162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775899162"}]},"ts":"1689775899162"} 2023-07-19 14:11:39,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 181adeab01e97d9f765e965be8d384f0, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:39,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 01ff527b17d107f157e480afe9238e15, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:11:39,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:39,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:39,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:39,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 181adeab01e97d9f765e965be8d384f0, disabling compactions & flushes 2023-07-19 14:11:39,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:39,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:39,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. after waiting 0 ms 2023-07-19 14:11:39,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:39,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 181adeab01e97d9f765e965be8d384f0 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 14:11:39,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01ff527b17d107f157e480afe9238e15, disabling compactions & flushes 2023-07-19 14:11:39,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:39,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:39,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. after waiting 0 ms 2023-07-19 14:11:39,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:39,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 01ff527b17d107f157e480afe9238e15 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 14:11:39,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/.tmp/cf/367c7dee825a46b59e2cf43d27f5d013 2023-07-19 14:11:39,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/.tmp/cf/eef07f507d7f43eb967eba552ab42a3b 2023-07-19 14:11:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/.tmp/cf/eef07f507d7f43eb967eba552ab42a3b as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf/eef07f507d7f43eb967eba552ab42a3b 2023-07-19 14:11:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/.tmp/cf/367c7dee825a46b59e2cf43d27f5d013 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf/367c7dee825a46b59e2cf43d27f5d013 2023-07-19 14:11:39,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf/367c7dee825a46b59e2cf43d27f5d013, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 14:11:39,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 01ff527b17d107f157e480afe9238e15 in 54ms, sequenceid=5, compaction requested=false 2023-07-19 14:11:39,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 14:11:39,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf/eef07f507d7f43eb967eba552ab42a3b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 14:11:39,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 181adeab01e97d9f765e965be8d384f0 in 61ms, sequenceid=5, compaction requested=false 2023-07-19 14:11:39,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 14:11:39,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:39,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15. 2023-07-19 14:11:39,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01ff527b17d107f157e480afe9238e15: 2023-07-19 14:11:39,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:39,394 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=01ff527b17d107f157e480afe9238e15, regionState=CLOSED 2023-07-19 14:11:39,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775899394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775899394"}]},"ts":"1689775899394"} 2023-07-19 14:11:39,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-19 14:11:39,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 01ff527b17d107f157e480afe9238e15, server=jenkins-hbase4.apache.org,42107,1689775816952 in 230 msec 2023-07-19 14:11:39,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=01ff527b17d107f157e480afe9238e15, UNASSIGN in 242 msec 2023-07-19 14:11:39,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 14:11:39,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:39,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0. 2023-07-19 14:11:39,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 181adeab01e97d9f765e965be8d384f0: 2023-07-19 14:11:39,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:39,409 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=181adeab01e97d9f765e965be8d384f0, regionState=CLOSED 2023-07-19 14:11:39,409 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775899409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775899409"}]},"ts":"1689775899409"} 2023-07-19 14:11:39,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-19 14:11:39,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 181adeab01e97d9f765e965be8d384f0, server=jenkins-hbase4.apache.org,34233,1689775817080 in 245 msec 2023-07-19 14:11:39,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 14:11:39,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=181adeab01e97d9f765e965be8d384f0, UNASSIGN in 260 msec 2023-07-19 14:11:39,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:39,499 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 14:11:39,501 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897980.181adeab01e97d9f765e965be8d384f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:39,501 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775897980.01ff527b17d107f157e480afe9238e15.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:39,501 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:39,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, ASSIGN}] 2023-07-19 14:11:39,574 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, ASSIGN 2023-07-19 14:11:39,575 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:11:39,680 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:39,726 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 14:11:39,728 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=97cb546239b3876d02a9cbc8497eaab0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:39,728 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775899728"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775899728"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775899728"}]},"ts":"1689775899728"} 2023-07-19 14:11:39,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 97cb546239b3876d02a9cbc8497eaab0, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:39,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:39,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 97cb546239b3876d02a9cbc8497eaab0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:11:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. service=AccessControlService 2023-07-19 14:11:39,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:39,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/.regioninfo 2023-07-19 14:11:39,901 INFO [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,902 DEBUG [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf 2023-07-19 14:11:39,903 DEBUG [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf 2023-07-19 14:11:39,903 INFO [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97cb546239b3876d02a9cbc8497eaab0 columnFamilyName cf 2023-07-19 14:11:39,947 DEBUG [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] regionserver.HStore(539): loaded hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/367c7dee825a46b59e2cf43d27f5d013.01ff527b17d107f157e480afe9238e15->hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf/367c7dee825a46b59e2cf43d27f5d013-top 2023-07-19 14:11:39,953 DEBUG [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] regionserver.HStore(539): loaded hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/eef07f507d7f43eb967eba552ab42a3b.181adeab01e97d9f765e965be8d384f0->hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf/eef07f507d7f43eb967eba552ab42a3b-top 2023-07-19 14:11:39,954 INFO [StoreOpener-97cb546239b3876d02a9cbc8497eaab0-1] regionserver.HStore(310): Store=97cb546239b3876d02a9cbc8497eaab0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:39,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:39,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 97cb546239b3876d02a9cbc8497eaab0; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65781445, jitterRate=-0.019780084490776062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:39,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 97cb546239b3876d02a9cbc8497eaab0: 2023-07-19 14:11:39,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0., pid=77, masterSystemTime=1689775899883 2023-07-19 14:11:39,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.,because compaction is disabled. 2023-07-19 14:11:39,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:39,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:39,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=97cb546239b3876d02a9cbc8497eaab0, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:39,974 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775899974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775899974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775899974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775899974"}]},"ts":"1689775899974"} 2023-07-19 14:11:39,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 14:11:39,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 97cb546239b3876d02a9cbc8497eaab0, server=jenkins-hbase4.apache.org,34233,1689775817080 in 247 msec 2023-07-19 14:11:39,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 14:11:39,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, ASSIGN in 406 msec 2023-07-19 14:11:39,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[181adeab01e97d9f765e965be8d384f0, 01ff527b17d107f157e480afe9238e15], force=true in 857 msec 2023-07-19 14:11:40,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:40,244 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 14:11:40,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 14:11:40,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775900245 (current time:1689775900245). 2023-07-19 14:11:40,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:40,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x4127059b to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:40,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a37346b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:40,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:40,269 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:40,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4127059b to 127.0.0.1:54361 2023-07-19 14:11:40,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:40,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x3d9dbe3d to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:40,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44ef7fc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:40,287 DEBUG [hconnection-0x27189f52-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:40,288 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d9dbe3d to 127.0.0.1:54361 2023-07-19 14:11:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 14:11:40,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:40,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 14:11:40,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 14:11:40,306 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 14:11:40,306 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689776500306 2023-07-19 14:11:40,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 14:11:40,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,308 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:40,308 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:40,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 14:11:40,309 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 14:11:40,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-07-19 14:11:40,312 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 14:11:40,313 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689776500313 2023-07-19 14:11:40,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,339 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 14:11:40,339 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:40,340 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 14:11:40,340 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 14:11:40,402 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,402 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,404 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:40,404 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:40,404 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:40,404 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,405 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,405 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 14:11:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 14:11:40,406 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 14:11:40,406 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,408 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:40,408 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 14:11:40,410 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 14:11:40,409 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 14:11:40,409 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 14:11:40,410 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:40,410 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 14:11:40,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,411 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 14:11:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 14:11:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 14:11:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 14:11:40,413 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 14:11:40,413 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 14:11:40,413 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 14:11:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 14:11:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:40,414 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,417 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,417 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,417 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,417 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,417 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:40,417 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,417 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:40,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 14:11:40,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70640865[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:40,421 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 14:11:40,421 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,422 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,422 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 14:11:40,422 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:11:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,423 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,423 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:40,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:40,423 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:40,424 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:40,424 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. started... 2023-07-19 14:11:40,425 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 97cb546239b3876d02a9cbc8497eaab0: 2023-07-19 14:11:40,425 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 14:11:40,425 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:40,425 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 14:11:40,426 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,427 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 14:11:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:40,427 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/367c7dee825a46b59e2cf43d27f5d013.01ff527b17d107f157e480afe9238e15->hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf/367c7dee825a46b59e2cf43d27f5d013-top, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/eef07f507d7f43eb967eba552ab42a3b.181adeab01e97d9f765e965be8d384f0->hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf/eef07f507d7f43eb967eba552ab42a3b-top] hfiles 2023-07-19 14:11:40,427 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 14:11:40,430 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/367c7dee825a46b59e2cf43d27f5d013.01ff527b17d107f157e480afe9238e15 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,431 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/eef07f507d7f43eb967eba552ab42a3b.181adeab01e97d9f765e965be8d384f0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,443 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. completed. 2023-07-19 14:11:40,444 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:40,444 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:40,444 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:40,444 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,444 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 14:11:40,444 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:11:40,451 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 14:11:40,451 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,451 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:40,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:40,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:40,451 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 14:11:40,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:40,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:40,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:40,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:11:40,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 14:11:40,457 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 14:11:40,457 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:40,457 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:40,457 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,457 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:40,459 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,459 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:40,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,459 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:40,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:40,460 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:40,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:40,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,460 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:40,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,461 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:40,461 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:40,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,462 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:40,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,465 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,465 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,465 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,469 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:40,469 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:40,469 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:40,470 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:40,469 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:40,470 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:40,470 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:40,470 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:40,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:40,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:40,470 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,471 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:40,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:40,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 14:11:40,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,532 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689775900307Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775900470 (+163 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775900470Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775900474 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775900487 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689775900531 (+44 ms) 2023-07-19 14:11:40,539 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 14:11:40,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 231 msec 2023-07-19 14:11:40,615 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:40,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 14:11:40,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:40,616 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616 2023-07-19 14:11:40,617 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40027, tgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616, rawTgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:11:40,661 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:11:40,661 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1041843164_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,662 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 14:11:40,689 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:40,806 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,806 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,807 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,807 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,808 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,808 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,809 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,894 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-5226941461783999175.jar 2023-07-19 14:11:40,895 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,896 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,896 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,897 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,897 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:40,898 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:40,899 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:40,899 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:40,900 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:40,901 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:40,901 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:40,902 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:40,902 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:40,903 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:40,903 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:40,904 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:40,904 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:40,905 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:40,905 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:40,906 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:40,906 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:40,907 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:41,149 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:11:42,626 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:42,631 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 14:11:42,633 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 14:11:42,776 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:42,776 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:42,944 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:49,182 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:51,540 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:55,972 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:57,949 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:57,952 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:57,964 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:57,964 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:57,965 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:57,965 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:57,965 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 14:11:57,965 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 14:11:57,966 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:57,967 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 14:11:57,967 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775900616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 14:11:57,976 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:57,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:57,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:57,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 14:11:57,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775917982"}]},"ts":"1689775917982"} 2023-07-19 14:11:57,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 14:11:57,986 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 14:11:57,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, UNASSIGN}] 2023-07-19 14:11:57,988 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, UNASSIGN 2023-07-19 14:11:57,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=97cb546239b3876d02a9cbc8497eaab0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:57,989 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775917989"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775917989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775917989"}]},"ts":"1689775917989"} 2023-07-19 14:11:57,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 97cb546239b3876d02a9cbc8497eaab0, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:58,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 14:11:58,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:58,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 97cb546239b3876d02a9cbc8497eaab0, disabling compactions & flushes 2023-07-19 14:11:58,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:58,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:58,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. after waiting 0 ms 2023-07-19 14:11:58,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:58,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 14:11:58,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:58,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0. 2023-07-19 14:11:58,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 97cb546239b3876d02a9cbc8497eaab0: 2023-07-19 14:11:58,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:58,165 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=97cb546239b3876d02a9cbc8497eaab0, regionState=CLOSED 2023-07-19 14:11:58,165 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775918165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775918165"}]},"ts":"1689775918165"} 2023-07-19 14:11:58,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 14:11:58,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 97cb546239b3876d02a9cbc8497eaab0, server=jenkins-hbase4.apache.org,34233,1689775817080 in 176 msec 2023-07-19 14:11:58,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 14:11:58,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=97cb546239b3876d02a9cbc8497eaab0, UNASSIGN in 193 msec 2023-07-19 14:11:58,184 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775918183"}]},"ts":"1689775918183"} 2023-07-19 14:11:58,191 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 14:11:58,193 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 14:11:58,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 217 msec 2023-07-19 14:11:58,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 14:11:58,285 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 14:11:58,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,292 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,294 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,298 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,298 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:58,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:58,301 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,301 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:58,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,304 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 14:11:58,307 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:58,313 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:58,313 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:58,314 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:58,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:58,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:58,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:58,317 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/recovered.edits] 2023-07-19 14:11:58,317 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/recovered.edits] 2023-07-19 14:11:58,317 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/recovered.edits] 2023-07-19 14:11:58,326 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/367c7dee825a46b59e2cf43d27f5d013.01ff527b17d107f157e480afe9238e15 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/367c7dee825a46b59e2cf43d27f5d013.01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:58,326 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf/367c7dee825a46b59e2cf43d27f5d013 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/cf/367c7dee825a46b59e2cf43d27f5d013 2023-07-19 14:11:58,329 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf/eef07f507d7f43eb967eba552ab42a3b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/cf/eef07f507d7f43eb967eba552ab42a3b 2023-07-19 14:11:58,329 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/eef07f507d7f43eb967eba552ab42a3b.181adeab01e97d9f765e965be8d384f0 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/cf/eef07f507d7f43eb967eba552ab42a3b.181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:58,332 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/recovered.edits/8.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15/recovered.edits/8.seqid 2023-07-19 14:11:58,333 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/01ff527b17d107f157e480afe9238e15 2023-07-19 14:11:58,334 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/recovered.edits/12.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0/recovered.edits/12.seqid 2023-07-19 14:11:58,335 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/97cb546239b3876d02a9cbc8497eaab0 2023-07-19 14:11:58,335 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/recovered.edits/8.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0/recovered.edits/8.seqid 2023-07-19 14:11:58,336 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/181adeab01e97d9f765e965be8d384f0 2023-07-19 14:11:58,336 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 14:11:58,338 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,353 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 14:11:58,360 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 14:11:58,363 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,363 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 14:11:58,363 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775918363"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:58,382 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 14:11:58,383 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 97cb546239b3876d02a9cbc8497eaab0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775897981.97cb546239b3876d02a9cbc8497eaab0.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 14:11:58,383 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 14:11:58,383 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775918383"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:58,391 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 14:11:58,394 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 108 msec 2023-07-19 14:11:58,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 14:11:58,407 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 14:11:58,407 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 14:11:58,412 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775918412"}]},"ts":"1689775918412"} 2023-07-19 14:11:58,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 14:11:58,421 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 14:11:58,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, UNASSIGN}] 2023-07-19 14:11:58,423 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, UNASSIGN 2023-07-19 14:11:58,425 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, UNASSIGN 2023-07-19 14:11:58,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a8ae79e0e0844d257ba126c9c3b8ef46, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:58,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775918427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775918427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775918427"}]},"ts":"1689775918427"} 2023-07-19 14:11:58,427 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=96714c5e8ffeb2c437ae6f80db08fc30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:58,427 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775918427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775918427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775918427"}]},"ts":"1689775918427"} 2023-07-19 14:11:58,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure a8ae79e0e0844d257ba126c9c3b8ef46, server=jenkins-hbase4.apache.org,44997,1689775817028}] 2023-07-19 14:11:58,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 96714c5e8ffeb2c437ae6f80db08fc30, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:58,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 14:11:58,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:58,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 96714c5e8ffeb2c437ae6f80db08fc30, disabling compactions & flushes 2023-07-19 14:11:58,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:58,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:58,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:58,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. after waiting 0 ms 2023-07-19 14:11:58,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a8ae79e0e0844d257ba126c9c3b8ef46, disabling compactions & flushes 2023-07-19 14:11:58,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:58,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:58,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:58,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. after waiting 0 ms 2023-07-19 14:11:58,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:58,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:58,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:58,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:58,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:58,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30. 2023-07-19 14:11:58,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46. 2023-07-19 14:11:58,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a8ae79e0e0844d257ba126c9c3b8ef46: 2023-07-19 14:11:58,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 96714c5e8ffeb2c437ae6f80db08fc30: 2023-07-19 14:11:58,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:58,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a8ae79e0e0844d257ba126c9c3b8ef46, regionState=CLOSED 2023-07-19 14:11:58,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775918632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775918632"}]},"ts":"1689775918632"} 2023-07-19 14:11:58,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:58,633 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=96714c5e8ffeb2c437ae6f80db08fc30, regionState=CLOSED 2023-07-19 14:11:58,633 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775918633"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775918633"}]},"ts":"1689775918633"} 2023-07-19 14:11:58,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-19 14:11:58,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure a8ae79e0e0844d257ba126c9c3b8ef46, server=jenkins-hbase4.apache.org,44997,1689775817028 in 203 msec 2023-07-19 14:11:58,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-19 14:11:58,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a8ae79e0e0844d257ba126c9c3b8ef46, UNASSIGN in 215 msec 2023-07-19 14:11:58,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 96714c5e8ffeb2c437ae6f80db08fc30, server=jenkins-hbase4.apache.org,34233,1689775817080 in 204 msec 2023-07-19 14:11:58,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-19 14:11:58,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=96714c5e8ffeb2c437ae6f80db08fc30, UNASSIGN in 216 msec 2023-07-19 14:11:58,652 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775918652"}]},"ts":"1689775918652"} 2023-07-19 14:11:58,654 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 14:11:58,656 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 14:11:58,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 251 msec 2023-07-19 14:11:58,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 14:11:58,715 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 14:11:58,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,719 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,720 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,721 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,724 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,724 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,724 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 14:11:58,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 14:11:58,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 14:11:58,725 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:58,725 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:58,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,726 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,727 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,727 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:58,727 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/recovered.edits] 2023-07-19 14:11:58,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 14:11:58,727 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/recovered.edits] 2023-07-19 14:11:58,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 14:11:58,727 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 14:11:58,735 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf/279f98c010614b4ab875d5cf03e965f3 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/cf/279f98c010614b4ab875d5cf03e965f3 2023-07-19 14:11:58,736 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf/3ee63368ec4b4c339386c1429805eb4c to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/cf/3ee63368ec4b4c339386c1429805eb4c 2023-07-19 14:11:58,740 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46/recovered.edits/9.seqid 2023-07-19 14:11:58,740 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30/recovered.edits/9.seqid 2023-07-19 14:11:58,740 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a8ae79e0e0844d257ba126c9c3b8ef46 2023-07-19 14:11:58,741 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/96714c5e8ffeb2c437ae6f80db08fc30 2023-07-19 14:11:58,741 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 14:11:58,741 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 14:11:58,742 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-19 14:11:58,746 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307196c313b0e677a463795bb9eb2a698eb27 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307196c313b0e677a463795bb9eb2a698eb27 2023-07-19 14:11:58,747 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071939ad21f986ea4306b85f704f18db97ff to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071939ad21f986ea4306b85f704f18db97ff 2023-07-19 14:11:58,748 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 14:11:58,750 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,753 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 14:11:58,760 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 14:11:58,766 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,766 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 14:11:58,766 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775918766"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:58,766 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775918766"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:58,768 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:11:58,768 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 96714c5e8ffeb2c437ae6f80db08fc30, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689775895839.96714c5e8ffeb2c437ae6f80db08fc30.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a8ae79e0e0844d257ba126c9c3b8ef46, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775895839.a8ae79e0e0844d257ba126c9c3b8ef46.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:11:58,768 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 14:11:58,768 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775918768"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:58,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 14:11:58,772 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 56 msec 2023-07-19 14:11:58,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 14:11:58,833 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 14:11:58,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 14:11:58,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 14:11:58,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:58,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 14:11:58,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:58,889 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 746) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:34576 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:40694 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095894682_1 at /127.0.0.1:40670 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:39821 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:60794 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4106 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2095894682_1 at /127.0.0.1:34546 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=536 (was 412) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=2608 (was 3027) 2023-07-19 14:11:58,889 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 14:11:58,920 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=536, ProcessCount=181, AvailableMemoryMB=2600 2023-07-19 14:11:58,920 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 14:11:58,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 14:11:58,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:11:58,927 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:58,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 14:11:58,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:58,930 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 2023-07-19 14:11:58,930 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:58,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:58,934 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 empty. 2023-07-19 14:11:58,934 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 empty. 2023-07-19 14:11:58,935 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 2023-07-19 14:11:58,935 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:58,935 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 14:11:58,951 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:58,953 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d3219807a059e0a33239839123abe51, NAME => 'testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:58,953 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 77f2fe2d9b84601e0c6cd5a02f0a7306, NAME => 'testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:11:58,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:58,985 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 77f2fe2d9b84601e0c6cd5a02f0a7306, disabling compactions & flushes 2023-07-19 14:11:58,985 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:58,985 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:58,985 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. after waiting 0 ms 2023-07-19 14:11:58,985 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:58,985 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:58,985 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 77f2fe2d9b84601e0c6cd5a02f0a7306: 2023-07-19 14:11:59,001 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:59,001 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5d3219807a059e0a33239839123abe51, disabling compactions & flushes 2023-07-19 14:11:59,001 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,001 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,001 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. after waiting 0 ms 2023-07-19 14:11:59,001 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,001 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,001 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5d3219807a059e0a33239839123abe51: 2023-07-19 14:11:59,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:59,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775919005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775919005"}]},"ts":"1689775919005"} 2023-07-19 14:11:59,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775919005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775919005"}]},"ts":"1689775919005"} 2023-07-19 14:11:59,008 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:59,009 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:59,009 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775919009"}]},"ts":"1689775919009"} 2023-07-19 14:11:59,013 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 14:11:59,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:59,018 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:59,018 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:59,018 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:59,018 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:59,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, ASSIGN}] 2023-07-19 14:11:59,021 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, ASSIGN 2023-07-19 14:11:59,021 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, ASSIGN 2023-07-19 14:11:59,027 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1689775816952; forceNewPlan=false, retain=false 2023-07-19 14:11:59,027 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:11:59,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:59,178 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:59,180 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5d3219807a059e0a33239839123abe51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,180 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=77f2fe2d9b84601e0c6cd5a02f0a7306, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,181 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775919180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775919180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775919180"}]},"ts":"1689775919180"} 2023-07-19 14:11:59,181 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775919180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775919180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775919180"}]},"ts":"1689775919180"} 2023-07-19 14:11:59,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 5d3219807a059e0a33239839123abe51, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:11:59,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 77f2fe2d9b84601e0c6cd5a02f0a7306, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:11:59,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:59,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d3219807a059e0a33239839123abe51, NAME => 'testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:11:59,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. service=AccessControlService 2023-07-19 14:11:59,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:59,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77f2fe2d9b84601e0c6cd5a02f0a7306, NAME => 'testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. service=AccessControlService 2023-07-19 14:11:59,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:59,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,341 INFO [StoreOpener-5d3219807a059e0a33239839123abe51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,342 INFO [StoreOpener-77f2fe2d9b84601e0c6cd5a02f0a7306-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,343 DEBUG [StoreOpener-5d3219807a059e0a33239839123abe51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf 2023-07-19 14:11:59,343 DEBUG [StoreOpener-5d3219807a059e0a33239839123abe51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf 2023-07-19 14:11:59,343 INFO [StoreOpener-5d3219807a059e0a33239839123abe51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d3219807a059e0a33239839123abe51 columnFamilyName cf 2023-07-19 14:11:59,343 DEBUG [StoreOpener-77f2fe2d9b84601e0c6cd5a02f0a7306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf 2023-07-19 14:11:59,343 DEBUG [StoreOpener-77f2fe2d9b84601e0c6cd5a02f0a7306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf 2023-07-19 14:11:59,344 INFO [StoreOpener-77f2fe2d9b84601e0c6cd5a02f0a7306-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77f2fe2d9b84601e0c6cd5a02f0a7306 columnFamilyName cf 2023-07-19 14:11:59,347 INFO [StoreOpener-77f2fe2d9b84601e0c6cd5a02f0a7306-1] regionserver.HStore(310): Store=77f2fe2d9b84601e0c6cd5a02f0a7306/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:59,347 INFO [StoreOpener-5d3219807a059e0a33239839123abe51-1] regionserver.HStore(310): Store=5d3219807a059e0a33239839123abe51/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:59,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:11:59,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:59,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77f2fe2d9b84601e0c6cd5a02f0a7306; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73794490, jitterRate=0.09962359070777893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:59,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77f2fe2d9b84601e0c6cd5a02f0a7306: 2023-07-19 14:11:59,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d3219807a059e0a33239839123abe51 2023-07-19 14:11:59,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306., pid=94, masterSystemTime=1689775919337 2023-07-19 14:11:59,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:59,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:59,356 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=77f2fe2d9b84601e0c6cd5a02f0a7306, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,357 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775919356"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775919356"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775919356"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775919356"}]},"ts":"1689775919356"} 2023-07-19 14:11:59,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 14:11:59,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 77f2fe2d9b84601e0c6cd5a02f0a7306, server=jenkins-hbase4.apache.org,34233,1689775817080 in 174 msec 2023-07-19 14:11:59,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, ASSIGN in 342 msec 2023-07-19 14:11:59,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:59,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d3219807a059e0a33239839123abe51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75051534, jitterRate=0.11835500597953796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:59,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d3219807a059e0a33239839123abe51: 2023-07-19 14:11:59,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51., pid=93, masterSystemTime=1689775919334 2023-07-19 14:11:59,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,366 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5d3219807a059e0a33239839123abe51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775919366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775919366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775919366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775919366"}]},"ts":"1689775919366"} 2023-07-19 14:11:59,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 14:11:59,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 5d3219807a059e0a33239839123abe51, server=jenkins-hbase4.apache.org,42107,1689775816952 in 186 msec 2023-07-19 14:11:59,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 14:11:59,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, ASSIGN in 351 msec 2023-07-19 14:11:59,372 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:59,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775919372"}]},"ts":"1689775919372"} 2023-07-19 14:11:59,373 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 14:11:59,377 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:59,377 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 14:11:59,379 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:11:59,380 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:59,380 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:59,380 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:59,380 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:59,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:59,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:59,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 460 msec 2023-07-19 14:11:59,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:59,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:59,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:59,538 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 14:11:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,544 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:59,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:59,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775919596 (current time:1689775919596). 2023-07-19 14:11:59,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:59,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x6080dead to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:59,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7acab303, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:59,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:59,632 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:59,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6080dead to 127.0.0.1:54361 2023-07-19 14:11:59,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:59,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x60a02769 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:59,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@633f866, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:59,646 DEBUG [hconnection-0x294e0108-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:59,650 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60a02769 to 127.0.0.1:54361 2023-07-19 14:11:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:11:59,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:59,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:59,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:59,660 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:59,661 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776519661 2023-07-19 14:11:59,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:59,661 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:59,663 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:59,663 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:59,664 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:59,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:59,665 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 14:11:59,669 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:59,670 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776519670 2023-07-19 14:11:59,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,684 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 14:11:59,684 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:59,687 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 14:11:59,688 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:11:59,688 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,688 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,698 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:59,698 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,698 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:59,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:59,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:59,699 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:59,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:59,699 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,699 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,700 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,700 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:59,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 14:11:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:59,701 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,702 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:59,702 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:59,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,704 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:59,704 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:59,704 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:59,704 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:59,704 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:59,705 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:59,708 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:59,708 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:59,710 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,710 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,710 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:59,711 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,711 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,711 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:59,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:59,711 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,712 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,712 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:59,712 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,712 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:59,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:59,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:59,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:11:59,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea07f91[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:59,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:11:59,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ea07f91[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:59,721 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:11:59,721 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,724 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:59,725 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,724 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:59,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:59,725 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,725 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:59,725 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:59,725 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:59,726 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,726 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. started... 2023-07-19 14:11:59,726 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. started... 2023-07-19 14:11:59,727 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77f2fe2d9b84601e0c6cd5a02f0a7306: 2023-07-19 14:11:59,728 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:59,728 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:59,728 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:59,729 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,729 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:59,729 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:59,734 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d3219807a059e0a33239839123abe51: 2023-07-19 14:11:59,739 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,739 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:59,739 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:59,758 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. completed. 2023-07-19 14:11:59,758 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:11:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:59,758 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:11:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:59,760 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:59,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:59,763 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:59,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:59,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:59,763 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. completed. 2023-07-19 14:11:59,764 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:59,764 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:11:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:59,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:59,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:59,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:59,765 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,766 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:59,766 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:59,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:11:59,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:11:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:59,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:59,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:59,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42107,1689775816952': 2023-07-19 14:11:59,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:11:59,774 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 14:11:59,774 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:59,774 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:59,774 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,774 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,777 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:59,777 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:59,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:59,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:59,778 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:59,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,779 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:59,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,781 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:59,781 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,781 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,784 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:59,784 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:59,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:59,784 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:59,785 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:59,785 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,785 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:59,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:59,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:59,785 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:59,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:59,785 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:59,785 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:59,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:11:59,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:59,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:11:59,787 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:11:59,788 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,788 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:59,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:59,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:59,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 14:11:59,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:59,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:59,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 14:11:59,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,922 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:59,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689775919661Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689775919805 (+144 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689775919805Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689775919805Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689775919813 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689775919859 (+46 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689775919921 (+62 ms) 2023-07-19 14:11:59,926 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:59,927 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 264 msec 2023-07-19 14:11:59,965 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:59,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:59,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:59,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:59,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:59,973 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:59,973 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:11:59,973 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:59,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:59,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775919984 (current time:1689775919984). 2023-07-19 14:11:59,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:59,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x04d6fffe to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:59,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dc9f82d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:59,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:59,997 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:59,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04d6fffe to 127.0.0.1:54361 2023-07-19 14:11:59,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:59,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x6b595f05 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:00,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58c3749f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:00,015 DEBUG [hconnection-0x4ad9f73a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:00,019 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:00,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b595f05 to 127.0.0.1:54361 2023-07-19 14:12:00,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:00,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:12:00,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:12:00,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:12:00,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:12:00,035 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:12:00,036 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776520036 2023-07-19 14:12:00,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 14:12:00,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:12:00,037 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:12:00,037 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:12:00,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:12:00,040 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:12:00,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-19 14:12:00,042 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:12:00,043 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776520043 2023-07-19 14:12:00,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,059 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 14:12:00,059 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:00,061 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 14:12:00,061 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:12:00,061 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,061 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,062 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:00,063 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:00,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:00,063 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:00,063 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:00,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:00,063 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,063 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,064 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,064 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:12:00,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 14:12:00,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:12:00,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:12:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:00,066 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:12:00,066 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:12:00,066 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:12:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,068 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 14:12:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:12:00,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,069 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:12:00,069 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:00,071 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:12:00,071 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:12:00,071 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:12:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 14:12:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:12:00,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,071 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:12:00,072 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:12:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:12:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:12:00,075 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:00,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:00,075 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,076 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:00,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:00,077 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,077 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:00,077 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,077 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:00,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:00,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:12:00,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2892d008[Count = 1] remaining members to acquire global barrier 2023-07-19 14:12:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:00,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:00,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:12:00,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2892d008[Count = 0] remaining members to acquire global barrier 2023-07-19 14:12:00,082 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:12:00,082 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:12:00,087 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,087 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:12:00,087 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:00,087 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:00,087 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:12:00,087 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:12:00,088 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:12:00,088 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:12:00,088 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. started... 2023-07-19 14:12:00,087 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:00,088 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:12:00,088 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:12:00,088 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5d3219807a059e0a33239839123abe51 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 14:12:00,088 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. started... 2023-07-19 14:12:00,088 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 77f2fe2d9b84601e0c6cd5a02f0a7306 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 14:12:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:12:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:00,090 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:12:00,137 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:00,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:12:00,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:00,139 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:12:00,141 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719348a0e3bf7304cea95bb6e398de5dc79 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719348a0e3bf7304cea95bb6e398de5dc79 2023-07-19 14:12:00,141 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719e5d308c332f446be960b3bdf27a2eeab to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719e5d308c332f446be960b3bdf27a2eeab 2023-07-19 14:12:00,153 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/.tmp/cf/f6e29f4182544098be8f7fcdb08283ec 2023-07-19 14:12:00,154 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/.tmp/cf/ab3118513c8245c8bd12ad0672bc4d1b 2023-07-19 14:12:00,160 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/.tmp/cf/ab3118513c8245c8bd12ad0672bc4d1b as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf/ab3118513c8245c8bd12ad0672bc4d1b 2023-07-19 14:12:00,161 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/.tmp/cf/f6e29f4182544098be8f7fcdb08283ec as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf/f6e29f4182544098be8f7fcdb08283ec 2023-07-19 14:12:00,168 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf/f6e29f4182544098be8f7fcdb08283ec, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 14:12:00,169 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5d3219807a059e0a33239839123abe51 in 81ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:00,169 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 14:12:00,170 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d3219807a059e0a33239839123abe51: 2023-07-19 14:12:00,170 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,172 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:00,172 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf/f6e29f4182544098be8f7fcdb08283ec] hfiles 2023-07-19 14:12:00,172 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf/f6e29f4182544098be8f7fcdb08283ec for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,179 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf/ab3118513c8245c8bd12ad0672bc4d1b, entries=46, sequenceid=6, filesize=12.9 K 2023-07-19 14:12:00,181 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 77f2fe2d9b84601e0c6cd5a02f0a7306 in 93ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:00,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77f2fe2d9b84601e0c6cd5a02f0a7306: 2023-07-19 14:12:00,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:00,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf/ab3118513c8245c8bd12ad0672bc4d1b] hfiles 2023-07-19 14:12:00,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf/ab3118513c8245c8bd12ad0672bc4d1b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,214 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. completed. 2023-07-19 14:12:00,215 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:12:00,215 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. completed. 2023-07-19 14:12:00,215 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:12:00,215 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:12:00,217 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:12:00,217 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,217 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:00,217 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:12:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:00,219 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,219 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:12:00,219 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:00,219 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:12:00,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:00,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:00,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:00,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42107,1689775816952': 2023-07-19 14:12:00,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:12:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:00,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:12:00,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:12:00,230 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 14:12:00,230 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:12:00,230 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:12:00,230 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,231 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:12:00,233 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:00,233 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,233 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:00,234 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:00,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:00,234 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:00,235 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,236 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:00,238 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,239 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,239 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:00,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:00,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:00,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:00,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:00,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:00,242 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:00,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:00,243 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:00,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:00,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:00,245 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,245 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:00,245 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 14:12:00,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:00,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:12:00,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:00,245 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:00,246 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:00,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:00,246 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:00,246 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,246 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719e5d308c332f446be960b3bdf27a2eeab, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719348a0e3bf7304cea95bb6e398de5dc79] mob files 2023-07-19 14:12:00,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719e5d308c332f446be960b3bdf27a2eeab 2023-07-19 14:12:00,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719348a0e3bf7304cea95bb6e398de5dc79 2023-07-19 14:12:00,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,339 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:00,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:12:00,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:00,341 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:12:00,641 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:12:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:00,643 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 14:12:00,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 14:12:00,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,726 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:00,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689775920036Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689775920259 (+223 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689775920259Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689775920260 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689775920265 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689775920275 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689775920726 (+451 ms) 2023-07-19 14:12:00,729 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:12:00,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 692 msec 2023-07-19 14:12:01,143 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:01,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:12:01,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:12:01,145 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145 2023-07-19 14:12:01,145 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40027, tgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145, rawTgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:12:01,176 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:12:01,176 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-562962625_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:01,176 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 14:12:01,188 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:01,655 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,656 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,656 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,657 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,657 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,658 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,658 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,758 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-683698573747773689.jar 2023-07-19 14:12:01,759 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,759 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,760 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,760 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,761 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,761 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:01,762 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:12:01,763 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:12:01,763 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:12:01,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:12:01,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:12:01,765 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:12:01,766 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:12:01,766 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:12:01,767 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:12:01,767 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:12:01,768 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:01,768 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:01,769 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:01,769 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:01,770 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:01,770 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:01,771 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:02,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0005_000001 (auth:SIMPLE) 2023-07-19 14:12:03,563 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:12:03,567 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 14:12:03,894 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:12:04,238 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:12:04,238 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:12:04,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0006_000001 (auth:SIMPLE) 2023-07-19 14:12:10,495 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0006_000001 (auth:SIMPLE) 2023-07-19 14:12:13,372 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:12:13,373 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:12:13,377 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:13,377 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:12:13,378 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:12:13,378 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:13,378 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 14:12:13,378 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 14:12:13,378 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:13,379 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 14:12:13,379 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775921145/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 14:12:13,384 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 14:12:13,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775933388"}]},"ts":"1689775933388"} 2023-07-19 14:12:13,389 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 14:12:13,391 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 14:12:13,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, UNASSIGN}] 2023-07-19 14:12:13,395 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, UNASSIGN 2023-07-19 14:12:13,395 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, UNASSIGN 2023-07-19 14:12:13,396 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5d3219807a059e0a33239839123abe51, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:13,396 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=77f2fe2d9b84601e0c6cd5a02f0a7306, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:13,396 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775933396"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775933396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775933396"}]},"ts":"1689775933396"} 2023-07-19 14:12:13,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775933396"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775933396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775933396"}]},"ts":"1689775933396"} 2023-07-19 14:12:13,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 5d3219807a059e0a33239839123abe51, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:12:13,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 77f2fe2d9b84601e0c6cd5a02f0a7306, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:12:13,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 14:12:13,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:12:13,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d3219807a059e0a33239839123abe51 2023-07-19 14:12:13,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77f2fe2d9b84601e0c6cd5a02f0a7306, disabling compactions & flushes 2023-07-19 14:12:13,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d3219807a059e0a33239839123abe51, disabling compactions & flushes 2023-07-19 14:12:13,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:12:13,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:12:13,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:12:13,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:12:13,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. after waiting 0 ms 2023-07-19 14:12:13,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:12:13,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. after waiting 0 ms 2023-07-19 14:12:13,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:12:13,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:13,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:13,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:13,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:13,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51. 2023-07-19 14:12:13,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306. 2023-07-19 14:12:13,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d3219807a059e0a33239839123abe51: 2023-07-19 14:12:13,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77f2fe2d9b84601e0c6cd5a02f0a7306: 2023-07-19 14:12:13,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:12:13,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=77f2fe2d9b84601e0c6cd5a02f0a7306, regionState=CLOSED 2023-07-19 14:12:13,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775933565"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775933565"}]},"ts":"1689775933565"} 2023-07-19 14:12:13,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d3219807a059e0a33239839123abe51 2023-07-19 14:12:13,566 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5d3219807a059e0a33239839123abe51, regionState=CLOSED 2023-07-19 14:12:13,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775933566"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775933566"}]},"ts":"1689775933566"} 2023-07-19 14:12:13,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 14:12:13,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 77f2fe2d9b84601e0c6cd5a02f0a7306, server=jenkins-hbase4.apache.org,34233,1689775817080 in 168 msec 2023-07-19 14:12:13,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 14:12:13,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 5d3219807a059e0a33239839123abe51, server=jenkins-hbase4.apache.org,42107,1689775816952 in 171 msec 2023-07-19 14:12:13,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=77f2fe2d9b84601e0c6cd5a02f0a7306, UNASSIGN in 179 msec 2023-07-19 14:12:13,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 14:12:13,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d3219807a059e0a33239839123abe51, UNASSIGN in 179 msec 2023-07-19 14:12:13,572 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775933572"}]},"ts":"1689775933572"} 2023-07-19 14:12:13,573 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 14:12:13,575 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 14:12:13,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 192 msec 2023-07-19 14:12:13,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 14:12:13,690 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 14:12:13,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,695 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,697 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,701 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,708 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,708 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,708 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,709 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:13,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:13,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:13,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:13,711 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 2023-07-19 14:12:13,711 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:12:13,712 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,712 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:13,712 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,712 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:13,712 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,712 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 14:12:13,713 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,713 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:13,714 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/recovered.edits] 2023-07-19 14:12:13,716 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/recovered.edits] 2023-07-19 14:12:13,722 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf/ab3118513c8245c8bd12ad0672bc4d1b to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/cf/ab3118513c8245c8bd12ad0672bc4d1b 2023-07-19 14:12:13,726 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306/recovered.edits/9.seqid 2023-07-19 14:12:13,727 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/77f2fe2d9b84601e0c6cd5a02f0a7306 2023-07-19 14:12:13,738 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf/f6e29f4182544098be8f7fcdb08283ec to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/cf/f6e29f4182544098be8f7fcdb08283ec 2023-07-19 14:12:13,754 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51/recovered.edits/9.seqid 2023-07-19 14:12:13,755 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d3219807a059e0a33239839123abe51 2023-07-19 14:12:13,755 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 14:12:13,756 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 14:12:13,757 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-19 14:12:13,762 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719e5d308c332f446be960b3bdf27a2eeab to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230719e5d308c332f446be960b3bdf27a2eeab 2023-07-19 14:12:13,764 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719348a0e3bf7304cea95bb6e398de5dc79 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719348a0e3bf7304cea95bb6e398de5dc79 2023-07-19 14:12:13,764 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 14:12:13,769 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,771 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 14:12:13,780 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 14:12:13,782 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,783 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 14:12:13,783 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775933783"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:13,783 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775933783"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:13,786 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:12:13,786 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5d3219807a059e0a33239839123abe51, NAME => 'testtb-testEmptyExportFileSystemState,,1689775918921.5d3219807a059e0a33239839123abe51.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 77f2fe2d9b84601e0c6cd5a02f0a7306, NAME => 'testtb-testEmptyExportFileSystemState,1,1689775918921.77f2fe2d9b84601e0c6cd5a02f0a7306.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:12:13,786 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 14:12:13,786 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775933786"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:13,788 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 14:12:13,790 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:13,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 99 msec 2023-07-19 14:12:13,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 14:12:13,816 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 14:12:13,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 14:12:13,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:13,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 14:12:13,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:13,874 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 760) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4910 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:49692 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:41511 from appattempt_1689775825007_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:53390 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-245535881_1 at /127.0.0.1:59076 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:42186 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:45883 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-245535881_1 at /127.0.0.1:42166 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=586 (was 536) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1811 (was 2600) 2023-07-19 14:12:13,874 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 14:12:13,907 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=586, ProcessCount=181, AvailableMemoryMB=1810 2023-07-19 14:12:13,907 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 14:12:13,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 14:12:13,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:13,915 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:12:13,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 14:12:13,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:12:13,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:13,919 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:13,919 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 2023-07-19 14:12:13,923 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 empty. 2023-07-19 14:12:13,923 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 empty. 2023-07-19 14:12:13,924 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:13,925 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 2023-07-19 14:12:13,925 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 14:12:13,939 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 14:12:13,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => fc6f766479e598b71e69388882450f14, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:12:13,948 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 98f18313b168da5af1ac77495dbc6dd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp 2023-07-19 14:12:13,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:13,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing fc6f766479e598b71e69388882450f14, disabling compactions & flushes 2023-07-19 14:12:13,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:13,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:13,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. after waiting 0 ms 2023-07-19 14:12:13,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:13,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:13,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for fc6f766479e598b71e69388882450f14: 2023-07-19 14:12:14,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:14,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 98f18313b168da5af1ac77495dbc6dd9, disabling compactions & flushes 2023-07-19 14:12:14,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. after waiting 0 ms 2023-07-19 14:12:14,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,000 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 98f18313b168da5af1ac77495dbc6dd9: 2023-07-19 14:12:14,004 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:12:14,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775934005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775934005"}]},"ts":"1689775934005"} 2023-07-19 14:12:14,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775934005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775934005"}]},"ts":"1689775934005"} 2023-07-19 14:12:14,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:12:14,008 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:12:14,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775934008"}]},"ts":"1689775934008"} 2023-07-19 14:12:14,010 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 14:12:14,013 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:12:14,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:12:14,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:12:14,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:12:14,015 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:12:14,015 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, ASSIGN}] 2023-07-19 14:12:14,018 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, ASSIGN 2023-07-19 14:12:14,018 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, ASSIGN 2023-07-19 14:12:14,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:14,027 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34233,1689775817080; forceNewPlan=false, retain=false 2023-07-19 14:12:14,027 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1689775816952; forceNewPlan=false, retain=false 2023-07-19 14:12:14,178 INFO [jenkins-hbase4:42625] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:12:14,181 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fc6f766479e598b71e69388882450f14, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=98f18313b168da5af1ac77495dbc6dd9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775934181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775934181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775934181"}]},"ts":"1689775934181"} 2023-07-19 14:12:14,181 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775934181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775934181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775934181"}]},"ts":"1689775934181"} 2023-07-19 14:12:14,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 98f18313b168da5af1ac77495dbc6dd9, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:12:14,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure fc6f766479e598b71e69388882450f14, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:12:14,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:14,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98f18313b168da5af1ac77495dbc6dd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:12:14,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:14,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc6f766479e598b71e69388882450f14, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:12:14,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. service=AccessControlService 2023-07-19 14:12:14,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. service=AccessControlService 2023-07-19 14:12:14,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:12:14,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:12:14,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,347 INFO [StoreOpener-98f18313b168da5af1ac77495dbc6dd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,347 INFO [StoreOpener-fc6f766479e598b71e69388882450f14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,349 DEBUG [StoreOpener-98f18313b168da5af1ac77495dbc6dd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf 2023-07-19 14:12:14,349 DEBUG [StoreOpener-fc6f766479e598b71e69388882450f14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf 2023-07-19 14:12:14,349 DEBUG [StoreOpener-98f18313b168da5af1ac77495dbc6dd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf 2023-07-19 14:12:14,349 DEBUG [StoreOpener-fc6f766479e598b71e69388882450f14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf 2023-07-19 14:12:14,350 INFO [StoreOpener-fc6f766479e598b71e69388882450f14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc6f766479e598b71e69388882450f14 columnFamilyName cf 2023-07-19 14:12:14,350 INFO [StoreOpener-98f18313b168da5af1ac77495dbc6dd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98f18313b168da5af1ac77495dbc6dd9 columnFamilyName cf 2023-07-19 14:12:14,353 INFO [StoreOpener-98f18313b168da5af1ac77495dbc6dd9-1] regionserver.HStore(310): Store=98f18313b168da5af1ac77495dbc6dd9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:12:14,353 INFO [StoreOpener-fc6f766479e598b71e69388882450f14-1] regionserver.HStore(310): Store=fc6f766479e598b71e69388882450f14/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:12:14,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:14,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fc6f766479e598b71e69388882450f14 2023-07-19 14:12:14,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:12:14,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98f18313b168da5af1ac77495dbc6dd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66843285, jitterRate=-0.003957435488700867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:12:14,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98f18313b168da5af1ac77495dbc6dd9: 2023-07-19 14:12:14,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9., pid=108, masterSystemTime=1689775934337 2023-07-19 14:12:14,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,402 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=98f18313b168da5af1ac77495dbc6dd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:12:14,402 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775934402"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775934402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775934402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775934402"}]},"ts":"1689775934402"} 2023-07-19 14:12:14,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fc6f766479e598b71e69388882450f14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74664926, jitterRate=0.11259409785270691}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:12:14,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fc6f766479e598b71e69388882450f14: 2023-07-19 14:12:14,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14., pid=109, masterSystemTime=1689775934338 2023-07-19 14:12:14,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:14,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:14,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 14:12:14,407 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fc6f766479e598b71e69388882450f14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 98f18313b168da5af1ac77495dbc6dd9, server=jenkins-hbase4.apache.org,42107,1689775816952 in 220 msec 2023-07-19 14:12:14,407 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775934407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775934407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775934407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775934407"}]},"ts":"1689775934407"} 2023-07-19 14:12:14,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, ASSIGN in 392 msec 2023-07-19 14:12:14,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 14:12:14,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure fc6f766479e598b71e69388882450f14, server=jenkins-hbase4.apache.org,34233,1689775817080 in 224 msec 2023-07-19 14:12:14,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 14:12:14,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, ASSIGN in 398 msec 2023-07-19 14:12:14,417 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:12:14,417 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775934417"}]},"ts":"1689775934417"} 2023-07-19 14:12:14,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 14:12:14,424 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:12:14,425 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 14:12:14,427 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 14:12:14,433 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:14,433 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:14,433 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:14,433 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:14,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:14,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:14,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:14,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:14,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 526 msec 2023-07-19 14:12:14,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:14,524 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 14:12:14,526 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,526 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,529 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:12:14,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:14,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775934548 (current time:1689775934548). 2023-07-19 14:12:14,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:12:14,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x4af0371f to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74b4dbb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:14,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:14,601 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:14,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af0371f to 127.0.0.1:54361 2023-07-19 14:12:14,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:14,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x727fe90c to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:14,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@397c7093, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:14,616 DEBUG [hconnection-0x6bc75557-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:14,617 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:14,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x727fe90c to 127.0.0.1:54361 2023-07-19 14:12:14,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:14,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 14:12:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:12:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:14,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:14,631 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:14,631 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689776534631 2023-07-19 14:12:14,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:14,633 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:12:14,634 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:12:14,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:14,636 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:14,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-19 14:12:14,638 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:14,639 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689776534639 2023-07-19 14:12:14,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,670 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 14:12:14,670 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:14,673 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 14:12:14,673 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 14:12:14,674 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,674 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,676 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:14,676 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:14,676 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:14,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:14,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:14,676 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:14,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:14,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:14,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:14,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,676 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,676 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,677 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,677 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:12:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 14:12:14,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:14,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 14:12:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 14:12:14,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,679 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:14,679 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:14,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,683 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:14,683 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:14,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,683 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:14,683 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:14,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:14,687 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:14,687 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:14,687 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:14,696 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,696 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,696 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:14,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:14,697 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,697 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:14,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:14,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dead17[Count = 1] remaining members to acquire global barrier 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:14,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:14,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:14,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dead17[Count = 0] remaining members to acquire global barrier 2023-07-19 14:12:14,702 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 14:12:14,702 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:14,704 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:12:14,704 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,704 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:12:14,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,705 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:14,705 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:14,705 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:14,705 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:14,705 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:14,705 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:14,705 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:14,705 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,705 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. started... 2023-07-19 14:12:14,705 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. started... 2023-07-19 14:12:14,707 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc6f766479e598b71e69388882450f14: 2023-07-19 14:12:14,707 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98f18313b168da5af1ac77495dbc6dd9: 2023-07-19 14:12:14,707 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,707 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,707 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:14,708 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:14,708 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:12:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:14,708 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:12:14,734 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:14,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:14,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:14,735 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:12:14,765 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. completed. 2023-07-19 14:12:14,765 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:12:14,766 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. completed. 2023-07-19 14:12:14,766 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:14,766 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:14,766 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:14,766 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,766 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:14,767 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:12:14,768 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:14,768 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,768 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,768 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:14,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:14,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:14,771 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,771 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:14,771 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:14,771 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:14,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42107,1689775816952': 2023-07-19 14:12:14,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 14:12:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:14,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:14,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:14,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:14,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:12:14,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 14:12:14,790 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 14:12:14,791 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:12:14,791 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:12:14,791 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,791 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:12:14,792 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,792 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:14,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:14,793 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:14,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:14,793 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,793 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:14,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:14,794 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:14,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,794 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,801 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:14,801 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,802 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:14,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:14,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:14,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:14,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:12:14,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:14,806 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:14,806 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:14,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:14,809 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 14:12:14,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,811 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 14:12:14,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689775934632Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689775934829 (+197 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775934829Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775934829Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775934838 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775934849 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689775934891 (+42 ms) 2023-07-19 14:12:14,896 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:14,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 263 msec 2023-07-19 14:12:14,935 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:14,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:14,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:12:14,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:12:14,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34233] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:12:14,944 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:14,944 DEBUG [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:14,944 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:12:14,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:14,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775934958 (current time:1689775934958). 2023-07-19 14:12:14,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:12:14,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x034a47e4 to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:14,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5276d737, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:14,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:14,980 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:14,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x034a47e4 to 127.0.0.1:54361 2023-07-19 14:12:14,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:14,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(139): Connect 0x0ab4990e to 127.0.0.1:54361 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:14,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b108adb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:14,994 DEBUG [hconnection-0x3fbb31e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:14,998 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:15,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ab4990e to 127.0.0.1:54361 2023-07-19 14:12:15,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:15,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 14:12:15,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:12:15,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:15,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:15,012 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:15,013 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689776535013 2023-07-19 14:12:15,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:15,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,014 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:12:15,014 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:12:15,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:15,016 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:15,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-19 14:12:15,018 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:15,019 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689776535019 2023-07-19 14:12:15,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,039 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 14:12:15,039 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:15,041 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 14:12:15,041 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 14:12:15,042 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,042 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,044 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:15,044 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:15,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:15,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:15,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:15,044 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:15,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:15,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:15,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:15,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,046 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,046 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,046 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 14:12:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 14:12:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,047 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,047 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:12:15,047 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 14:12:15,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,048 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:15,048 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:15,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,048 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:15,048 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:15,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,048 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:15,048 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:15,052 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:15,052 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:15,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,052 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:15,053 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:15,053 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:15,052 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:15,054 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:15,054 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:15,053 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44997,1689775817028' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:15,054 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:15,054 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:15,056 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,056 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:15,056 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,056 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:15,057 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,057 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:15,063 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,062 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,063 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:15,063 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,063 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:15,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1689775816952' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:15,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529bae9[Count = 1] remaining members to acquire global barrier 2023-07-19 14:12:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:15,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34233,1689775817080' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:15,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5529bae9[Count = 0] remaining members to acquire global barrier 2023-07-19 14:12:15,071 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 14:12:15,071 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,077 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,077 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,077 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:15,078 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44997,1689775817028' in zk 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:15,078 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:15,078 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:15,079 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. started... 2023-07-19 14:12:15,079 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,079 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:12:15,079 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc6f766479e598b71e69388882450f14 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 14:12:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:15,080 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:15,080 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:15,080 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. started... 2023-07-19 14:12:15,080 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:15,080 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 98f18313b168da5af1ac77495dbc6dd9 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 14:12:15,080 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:15,080 DEBUG [member: 'jenkins-hbase4.apache.org,44997,1689775817028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:15,115 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:15,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:15,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:15,121 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:12:15,130 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719bad3e07ec8be4f00a2c6213c9e78b7c4 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719bad3e07ec8be4f00a2c6213c9e78b7c4 2023-07-19 14:12:15,135 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719197fce277952400c8abf21cdba61e900 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230719197fce277952400c8abf21cdba61e900 2023-07-19 14:12:15,155 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/.tmp/cf/644115088af342f88af3327000b3c34e 2023-07-19 14:12:15,161 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/.tmp/cf/644115088af342f88af3327000b3c34e as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf/644115088af342f88af3327000b3c34e 2023-07-19 14:12:15,167 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf/644115088af342f88af3327000b3c34e, entries=44, sequenceid=6, filesize=12.8 K 2023-07-19 14:12:15,168 INFO [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for fc6f766479e598b71e69388882450f14 in 89ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:15,169 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 14:12:15,169 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/.tmp/cf/6fd88bd01a2649c282ce44ad101f3a27 2023-07-19 14:12:15,169 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc6f766479e598b71e69388882450f14: 2023-07-19 14:12:15,169 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,169 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:15,170 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf/644115088af342f88af3327000b3c34e] hfiles 2023-07-19 14:12:15,170 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf/644115088af342f88af3327000b3c34e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. completed. 2023-07-19 14:12:15,183 DEBUG [rs(jenkins-hbase4.apache.org,34233,1689775817080)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:15,184 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34233,1689775817080' in zk 2023-07-19 14:12:15,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:15,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:15,186 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/.tmp/cf/6fd88bd01a2649c282ce44ad101f3a27 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf/6fd88bd01a2649c282ce44ad101f3a27 2023-07-19 14:12:15,186 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:15,186 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:15,186 DEBUG [member: 'jenkins-hbase4.apache.org,34233,1689775817080' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:15,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:15,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:15,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:15,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,196 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf/6fd88bd01a2649c282ce44ad101f3a27, entries=6, sequenceid=6, filesize=6.0 K 2023-07-19 14:12:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34233,1689775817080': 2023-07-19 14:12:15,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34233,1689775817080' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 14:12:15,201 INFO [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 98f18313b168da5af1ac77495dbc6dd9 in 121ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:15,202 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98f18313b168da5af1ac77495dbc6dd9: 2023-07-19 14:12:15,203 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,203 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:15,203 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf/6fd88bd01a2649c282ce44ad101f3a27] hfiles 2023-07-19 14:12:15,203 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf/6fd88bd01a2649c282ce44ad101f3a27 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,218 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. completed. 2023-07-19 14:12:15,218 DEBUG [rs(jenkins-hbase4.apache.org,42107,1689775816952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:15,218 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:15,218 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:15,218 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,218 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:15,218 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42107,1689775816952' in zk 2023-07-19 14:12:15,220 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:15,220 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:15,220 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,220 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1689775816952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:15,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:15,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:15,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:15,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:15,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:15,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42107,1689775816952': 2023-07-19 14:12:15,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1689775816952' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 14:12:15,227 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 14:12:15,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:12:15,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:12:15,227 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,227 INFO [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:15,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:15,232 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:15,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,232 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,234 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:15,236 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,236 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,237 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:15,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:15,241 DEBUG [(jenkins-hbase4.apache.org,42625,1689775815479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:15,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,240 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:15,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,241 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:12:15,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:15,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 14:12:15,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:15,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,243 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:15,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:15,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719bad3e07ec8be4f00a2c6213c9e78b7c4, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230719197fce277952400c8abf21cdba61e900] mob files 2023-07-19 14:12:15,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719bad3e07ec8be4f00a2c6213c9e78b7c4 2023-07-19 14:12:15,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230719197fce277952400c8abf21cdba61e900 2023-07-19 14:12:15,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,321 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:15,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:15,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:15,323 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:12:15,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 14:12:15,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,346 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689775935013Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689775935265 (+252 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689775935265Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689775935265Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689775935276 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689775935316 (+40 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689775935346 (+30 ms) 2023-07-19 14:12:15,349 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:15,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 336 msec 2023-07-19 14:12:15,623 DEBUG [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:15,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:15,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:12:15,624 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624 2023-07-19 14:12:15,625 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40027, tgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624, rawTgtDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624, srcFsUri=hdfs://localhost:40027, srcDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:12:15,654 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0 2023-07-19 14:12:15,654 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-816957986_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,654 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40027, inputRoot=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0, snapshotDir=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 14:12:15,683 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:15,763 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,763 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,764 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,765 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,844 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/hadoop-7116421267507943807.jar 2023-07-19 14:12:15,845 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,845 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,846 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,846 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:15,847 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:12:15,848 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:12:15,848 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:12:15,848 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:12:15,849 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:12:15,849 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:12:15,849 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:12:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:12:15,850 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:12:15,851 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:12:15,851 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:15,852 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:15,852 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:15,854 DEBUG [Listener at jenkins-hbase4.apache.org/37607] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:17,659 WARN [Listener at jenkins-hbase4.apache.org/37607] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:12:17,662 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 14:12:17,665 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-19 14:12:18,052 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:12:18,053 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:12:18,062 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0006_000001 (auth:SIMPLE) 2023-07-19 14:12:18,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:19,171 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:12:23,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:26,093 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:30,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825007_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:32,080 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:12:32,080 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:12:32,092 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,092 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:12:32,092 INFO [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:12:32,093 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,093 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 14:12:32,093 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 14:12:32,093 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1066177687_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,094 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 14:12:32,094 DEBUG [Listener at jenkins-hbase4.apache.org/37607] snapshot.TestExportSnapshot(367): hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/export-test/export-1689775935624/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 14:12:32,100 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 14:12:32,105 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775952104"}]},"ts":"1689775952104"} 2023-07-19 14:12:32,106 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 14:12:32,108 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 14:12:32,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, UNASSIGN}] 2023-07-19 14:12:32,110 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, UNASSIGN 2023-07-19 14:12:32,111 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, UNASSIGN 2023-07-19 14:12:32,111 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fc6f766479e598b71e69388882450f14, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:12:32,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775952111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775952111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775952111"}]},"ts":"1689775952111"} 2023-07-19 14:12:32,111 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=98f18313b168da5af1ac77495dbc6dd9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:12:32,112 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775952111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775952111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775952111"}]},"ts":"1689775952111"} 2023-07-19 14:12:32,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure fc6f766479e598b71e69388882450f14, server=jenkins-hbase4.apache.org,34233,1689775817080}] 2023-07-19 14:12:32,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 98f18313b168da5af1ac77495dbc6dd9, server=jenkins-hbase4.apache.org,42107,1689775816952}] 2023-07-19 14:12:32,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 14:12:32,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fc6f766479e598b71e69388882450f14 2023-07-19 14:12:32,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fc6f766479e598b71e69388882450f14, disabling compactions & flushes 2023-07-19 14:12:32,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:32,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:32,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. after waiting 0 ms 2023-07-19 14:12:32,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:32,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:32,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98f18313b168da5af1ac77495dbc6dd9, disabling compactions & flushes 2023-07-19 14:12:32,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:32,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:32,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. after waiting 0 ms 2023-07-19 14:12:32,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:32,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:32,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:32,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14. 2023-07-19 14:12:32,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fc6f766479e598b71e69388882450f14: 2023-07-19 14:12:32,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fc6f766479e598b71e69388882450f14 2023-07-19 14:12:32,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:32,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:32,293 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fc6f766479e598b71e69388882450f14, regionState=CLOSED 2023-07-19 14:12:32,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9. 2023-07-19 14:12:32,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775952293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775952293"}]},"ts":"1689775952293"} 2023-07-19 14:12:32,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98f18313b168da5af1ac77495dbc6dd9: 2023-07-19 14:12:32,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:32,300 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=98f18313b168da5af1ac77495dbc6dd9, regionState=CLOSED 2023-07-19 14:12:32,301 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775952300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775952300"}]},"ts":"1689775952300"} 2023-07-19 14:12:32,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-19 14:12:32,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure fc6f766479e598b71e69388882450f14, server=jenkins-hbase4.apache.org,34233,1689775817080 in 186 msec 2023-07-19 14:12:32,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fc6f766479e598b71e69388882450f14, UNASSIGN in 194 msec 2023-07-19 14:12:32,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-19 14:12:32,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 98f18313b168da5af1ac77495dbc6dd9, server=jenkins-hbase4.apache.org,42107,1689775816952 in 188 msec 2023-07-19 14:12:32,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 14:12:32,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=98f18313b168da5af1ac77495dbc6dd9, UNASSIGN in 197 msec 2023-07-19 14:12:32,307 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775952307"}]},"ts":"1689775952307"} 2023-07-19 14:12:32,308 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 14:12:32,310 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 14:12:32,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 211 msec 2023-07-19 14:12:32,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 14:12:32,407 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 14:12:32,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,411 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,412 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,415 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,417 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:32,417 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 2023-07-19 14:12:32,419 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/recovered.edits] 2023-07-19 14:12:32,419 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,419 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf, FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/recovered.edits] 2023-07-19 14:12:32,419 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,419 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,419 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:32,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:32,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:32,420 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:32,421 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 14:12:32,425 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf/644115088af342f88af3327000b3c34e to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/cf/644115088af342f88af3327000b3c34e 2023-07-19 14:12:32,425 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf/6fd88bd01a2649c282ce44ad101f3a27 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/cf/6fd88bd01a2649c282ce44ad101f3a27 2023-07-19 14:12:32,435 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9/recovered.edits/9.seqid 2023-07-19 14:12:32,436 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/98f18313b168da5af1ac77495dbc6dd9 2023-07-19 14:12:32,436 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/recovered.edits/9.seqid to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14/recovered.edits/9.seqid 2023-07-19 14:12:32,437 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fc6f766479e598b71e69388882450f14 2023-07-19 14:12:32,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 14:12:32,438 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 14:12:32,439 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-19 14:12:32,446 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719bad3e07ec8be4f00a2c6213c9e78b7c4 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719bad3e07ec8be4f00a2c6213c9e78b7c4 2023-07-19 14:12:32,447 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230719197fce277952400c8abf21cdba61e900 to hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230719197fce277952400c8abf21cdba61e900 2023-07-19 14:12:32,448 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 14:12:32,450 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,452 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 14:12:32,454 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 14:12:32,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 14:12:32,456 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775952456"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:32,456 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775952456"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:32,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:12:32,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 98f18313b168da5af1ac77495dbc6dd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689775933908.98f18313b168da5af1ac77495dbc6dd9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fc6f766479e598b71e69388882450f14, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775933908.fc6f766479e598b71e69388882450f14.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:12:32,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 14:12:32,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775952459"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:32,469 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 14:12:32,476 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 68 msec 2023-07-19 14:12:32,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 14:12:32,524 INFO [Listener at jenkins-hbase4.apache.org/37607] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 14:12:32,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 14:12:32,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 14:12:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42625] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:32,585 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5551 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:48542 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1956888074_1 at /127.0.0.1:39476 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1956888074_1 at /127.0.0.1:37654 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:39492 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3aa4d515-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (717546083) connection to jenkins-hbase4.apache.org/172.31.14.131:33047 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1066177687_17 at /127.0.0.1:37674 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=607 (was 586) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1651 (was 1810) 2023-07-19 14:12:32,585 WARN [Listener at jenkins-hbase4.apache.org/37607] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-19 14:12:32,585 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 14:12:32,597 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:12:32,710 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689775825007_0007_01_000001 is : 143 2023-07-19 14:12:37,861 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:12:46,718 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:13:00,841 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 14:13:00,842 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:13:00,954 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 14:13:00,968 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 14:13:00,969 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 14:13:00,984 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:13:01,088 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 14:13:01,089 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 14:13:01,089 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 14:13:01,089 INFO [Listener at jenkins-hbase4.apache.org/37607] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 14:13:01,089 DEBUG [Listener at jenkins-hbase4.apache.org/37607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44136387 to 127.0.0.1:54361 2023-07-19 14:13:01,089 DEBUG [Listener at jenkins-hbase4.apache.org/37607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,089 DEBUG [Listener at jenkins-hbase4.apache.org/37607] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 14:13:01,089 DEBUG [Listener at jenkins-hbase4.apache.org/37607] util.JVMClusterUtil(257): Found active master hash=180411656, stopped=false 2023-07-19 14:13:01,090 DEBUG [Listener at jenkins-hbase4.apache.org/37607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,090 DEBUG [Listener at jenkins-hbase4.apache.org/37607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 14:13:01,091 INFO [Listener at jenkins-hbase4.apache.org/37607] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:13:01,092 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:13:01,092 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:13:01,092 INFO [Listener at jenkins-hbase4.apache.org/37607] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 14:13:01,092 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:13:01,092 DEBUG [Listener at jenkins-hbase4.apache.org/37607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4108a756 to 127.0.0.1:54361 2023-07-19 14:13:01,092 DEBUG [Listener at jenkins-hbase4.apache.org/37607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,092 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:13:01,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:13:01,093 INFO [Listener at jenkins-hbase4.apache.org/37607] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42107,1689775816952' ***** 2023-07-19 14:13:01,092 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:13:01,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:13:01,093 DEBUG [Listener at jenkins-hbase4.apache.org/37607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:13:01,094 INFO [Listener at jenkins-hbase4.apache.org/37607] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 14:13:01,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:13:01,094 INFO [Listener at jenkins-hbase4.apache.org/37607] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44997,1689775817028' ***** 2023-07-19 14:13:01,094 INFO [RS:0;jenkins-hbase4:42107] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 14:13:01,094 DEBUG [Listener at jenkins-hbase4.apache.org/37607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,094 INFO [Listener at jenkins-hbase4.apache.org/37607] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 14:13:01,094 INFO [RS:0;jenkins-hbase4:42107] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 14:13:01,094 INFO [Listener at jenkins-hbase4.apache.org/37607] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34233,1689775817080' ***** 2023-07-19 14:13:01,094 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 14:13:01,094 DEBUG [Listener at jenkins-hbase4.apache.org/37607] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,094 INFO [RS:0;jenkins-hbase4:42107] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 14:13:01,094 INFO [Listener at jenkins-hbase4.apache.org/37607] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 14:13:01,094 INFO [RS:1;jenkins-hbase4:44997] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 14:13:01,095 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:13:01,095 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 14:13:01,095 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6132e8fe to 127.0.0.1:54361 2023-07-19 14:13:01,095 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,095 INFO [RS:1;jenkins-hbase4:44997] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 14:13:01,096 INFO [RS:1;jenkins-hbase4:44997] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 14:13:01,096 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(3305): Received CLOSE for 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:13:01,096 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:13:01,096 DEBUG [RS:1;jenkins-hbase4:44997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ddd21f8 to 127.0.0.1:54361 2023-07-19 14:13:01,096 DEBUG [RS:1;jenkins-hbase4:44997] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,097 INFO [RS:2;jenkins-hbase4:34233] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 14:13:01,097 INFO [RS:2;jenkins-hbase4:34233] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 14:13:01,097 INFO [RS:2;jenkins-hbase4:34233] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 14:13:01,097 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(3305): Received CLOSE for 435f3294234ae2acd05812673d039929 2023-07-19 14:13:01,097 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:13:01,097 DEBUG [RS:2;jenkins-hbase4:34233] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54df8342 to 127.0.0.1:54361 2023-07-19 14:13:01,097 DEBUG [RS:2;jenkins-hbase4:34233] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,097 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 14:13:01,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41f064f5da0c02f7e97975bd4958c797, disabling compactions & flushes 2023-07-19 14:13:01,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 435f3294234ae2acd05812673d039929, disabling compactions & flushes 2023-07-19 14:13:01,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:13:01,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:13:01,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. after waiting 0 ms 2023-07-19 14:13:01,100 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42107,1689775816952; all regions closed. 2023-07-19 14:13:01,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:13:01,100 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 14:13:01,100 INFO [RS:2;jenkins-hbase4:34233] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 14:13:01,101 INFO [RS:2;jenkins-hbase4:34233] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 14:13:01,101 INFO [RS:2;jenkins-hbase4:34233] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 14:13:01,101 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 14:13:01,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:13:01,101 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1478): Online Regions={41f064f5da0c02f7e97975bd4958c797=hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797.} 2023-07-19 14:13:01,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 41f064f5da0c02f7e97975bd4958c797 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 14:13:01,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:13:01,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. after waiting 0 ms 2023-07-19 14:13:01,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:13:01,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 435f3294234ae2acd05812673d039929 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 14:13:01,102 DEBUG [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1504): Waiting on 41f064f5da0c02f7e97975bd4958c797 2023-07-19 14:13:01,102 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 14:13:01,103 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1478): Online Regions={435f3294234ae2acd05812673d039929=hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929., 1588230740=hbase:meta,,1.1588230740} 2023-07-19 14:13:01,103 DEBUG [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1504): Waiting on 1588230740, 435f3294234ae2acd05812673d039929 2023-07-19 14:13:01,104 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 14:13:01,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 14:13:01,104 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 14:13:01,104 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 14:13:01,104 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 14:13:01,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 14:13:01,108 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:13:01,108 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:13:01,126 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:13:01,134 DEBUG [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs 2023-07-19 14:13:01,134 INFO [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42107%2C1689775816952:(num 1689775819750) 2023-07-19 14:13:01,135 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,135 INFO [RS:0;jenkins-hbase4:42107] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:13:01,162 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 14:13:01,163 INFO [RS:0;jenkins-hbase4:42107] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 14:13:01,163 INFO [RS:0;jenkins-hbase4:42107] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 14:13:01,163 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:13:01,163 INFO [RS:0;jenkins-hbase4:42107] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 14:13:01,165 INFO [RS:0;jenkins-hbase4:42107] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42107 2023-07-19 14:13:01,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/.tmp/info/ef06bb929a4c4e2b94235847b276bb2f 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42107,1689775816952 2023-07-19 14:13:01,186 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:13:01,187 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42107,1689775816952] 2023-07-19 14:13:01,189 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42107,1689775816952; numProcessing=1 2023-07-19 14:13:01,191 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42107,1689775816952 already deleted, retry=false 2023-07-19 14:13:01,191 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42107,1689775816952 expired; onlineServers=2 2023-07-19 14:13:01,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/.tmp/l/0c8bb177e0194241a805941d3dad6141 2023-07-19 14:13:01,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c8bb177e0194241a805941d3dad6141 2023-07-19 14:13:01,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/.tmp/l/0c8bb177e0194241a805941d3dad6141 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/l/0c8bb177e0194241a805941d3dad6141 2023-07-19 14:13:01,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/.tmp/info/ef06bb929a4c4e2b94235847b276bb2f as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/info/ef06bb929a4c4e2b94235847b276bb2f 2023-07-19 14:13:01,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/.tmp/info/1369fb903ee04f629173f6de0617fd1e 2023-07-19 14:13:01,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1369fb903ee04f629173f6de0617fd1e 2023-07-19 14:13:01,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c8bb177e0194241a805941d3dad6141 2023-07-19 14:13:01,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/l/0c8bb177e0194241a805941d3dad6141, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 14:13:01,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/info/ef06bb929a4c4e2b94235847b276bb2f, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 14:13:01,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 435f3294234ae2acd05812673d039929 in 107ms, sequenceid=18, compaction requested=false 2023-07-19 14:13:01,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 41f064f5da0c02f7e97975bd4958c797 in 109ms, sequenceid=6, compaction requested=false 2023-07-19 14:13:01,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/acl/435f3294234ae2acd05812673d039929/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 14:13:01,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:13:01,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 435f3294234ae2acd05812673d039929: 2023-07-19 14:13:01,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:13:01,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/namespace/41f064f5da0c02f7e97975bd4958c797/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:13:01,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:13:01,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41f064f5da0c02f7e97975bd4958c797: 2023-07-19 14:13:01,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689775820308.41f064f5da0c02f7e97975bd4958c797. 2023-07-19 14:13:01,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/.tmp/rep_barrier/2875ad841cf8451c80c990a3fa441d88 2023-07-19 14:13:01,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2875ad841cf8451c80c990a3fa441d88 2023-07-19 14:13:01,246 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/.tmp/table/a9625bb949784503a58d7b8e48776e7d 2023-07-19 14:13:01,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9625bb949784503a58d7b8e48776e7d 2023-07-19 14:13:01,250 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/.tmp/info/1369fb903ee04f629173f6de0617fd1e as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/info/1369fb903ee04f629173f6de0617fd1e 2023-07-19 14:13:01,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1369fb903ee04f629173f6de0617fd1e 2023-07-19 14:13:01,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/info/1369fb903ee04f629173f6de0617fd1e, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 14:13:01,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/.tmp/rep_barrier/2875ad841cf8451c80c990a3fa441d88 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/rep_barrier/2875ad841cf8451c80c990a3fa441d88 2023-07-19 14:13:01,259 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2875ad841cf8451c80c990a3fa441d88 2023-07-19 14:13:01,259 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/rep_barrier/2875ad841cf8451c80c990a3fa441d88, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 14:13:01,260 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/.tmp/table/a9625bb949784503a58d7b8e48776e7d as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/table/a9625bb949784503a58d7b8e48776e7d 2023-07-19 14:13:01,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9625bb949784503a58d7b8e48776e7d 2023-07-19 14:13:01,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/table/a9625bb949784503a58d7b8e48776e7d, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 14:13:01,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 161ms, sequenceid=131, compaction requested=false 2023-07-19 14:13:01,282 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 14:13:01,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:13:01,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 14:13:01,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 14:13:01,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 14:13:01,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 14:13:01,289 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:01,289 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42107,1689775816952; zookeeper connection closed. 2023-07-19 14:13:01,289 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x1017deb3a810001, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:01,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2130e85b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2130e85b 2023-07-19 14:13:01,302 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44997,1689775817028; all regions closed. 2023-07-19 14:13:01,303 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34233,1689775817080; all regions closed. 2023-07-19 14:13:01,312 DEBUG [RS:1;jenkins-hbase4:44997] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs 2023-07-19 14:13:01,312 INFO [RS:1;jenkins-hbase4:44997] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44997%2C1689775817028:(num 1689775819761) 2023-07-19 14:13:01,312 DEBUG [RS:1;jenkins-hbase4:44997] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,313 INFO [RS:1;jenkins-hbase4:44997] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:13:01,313 INFO [RS:1;jenkins-hbase4:44997] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 14:13:01,313 INFO [RS:1;jenkins-hbase4:44997] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 14:13:01,313 INFO [RS:1;jenkins-hbase4:44997] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 14:13:01,313 INFO [RS:1;jenkins-hbase4:44997] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 14:13:01,319 INFO [RS:1;jenkins-hbase4:44997] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44997 2023-07-19 14:13:01,319 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:13:01,328 DEBUG [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs 2023-07-19 14:13:01,328 INFO [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34233%2C1689775817080.meta:.meta(num 1689775819698) 2023-07-19 14:13:01,333 DEBUG [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/oldWALs 2023-07-19 14:13:01,333 INFO [RS:2;jenkins-hbase4:34233] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34233%2C1689775817080:(num 1689775819750) 2023-07-19 14:13:01,333 DEBUG [RS:2;jenkins-hbase4:34233] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,334 INFO [RS:2;jenkins-hbase4:34233] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:13:01,334 INFO [RS:2;jenkins-hbase4:34233] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 14:13:01,334 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:13:01,335 INFO [RS:2;jenkins-hbase4:34233] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34233 2023-07-19 14:13:01,398 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:13:01,399 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:13:01,399 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44997,1689775817028 2023-07-19 14:13:01,489 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:13:01,489 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34233,1689775817080] 2023-07-19 14:13:01,489 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34233,1689775817080 2023-07-19 14:13:01,490 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34233,1689775817080; numProcessing=2 2023-07-19 14:13:01,636 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34233,1689775817080 already deleted, retry=false 2023-07-19 14:13:01,636 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34233,1689775817080 expired; onlineServers=1 2023-07-19 14:13:01,636 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44997,1689775817028] 2023-07-19 14:13:01,636 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44997,1689775817028; numProcessing=3 2023-07-19 14:13:01,674 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:01,674 INFO [RS:1;jenkins-hbase4:44997] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44997,1689775817028; zookeeper connection closed. 2023-07-19 14:13:01,675 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:44997-0x1017deb3a810002, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:01,675 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@32644cd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@32644cd 2023-07-19 14:13:01,720 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44997,1689775817028 already deleted, retry=false 2023-07-19 14:13:01,720 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44997,1689775817028 expired; onlineServers=0 2023-07-19 14:13:01,720 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42625,1689775815479' ***** 2023-07-19 14:13:01,720 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 14:13:01,720 DEBUG [M:0;jenkins-hbase4:42625] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bfdd733, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:13:01,721 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42625,1689775815479 2023-07-19 14:13:01,721 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42625,1689775815479; all regions closed. 2023-07-19 14:13:01,721 DEBUG [M:0;jenkins-hbase4:42625] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:13:01,721 DEBUG [M:0;jenkins-hbase4:42625] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 14:13:01,721 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 14:13:01,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689775818755] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689775818755,5,FailOnTimeoutGroup] 2023-07-19 14:13:01,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689775818746] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689775818746,5,FailOnTimeoutGroup] 2023-07-19 14:13:01,721 DEBUG [M:0;jenkins-hbase4:42625] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 14:13:01,721 INFO [M:0;jenkins-hbase4:42625] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 14:13:01,721 INFO [M:0;jenkins-hbase4:42625] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 14:13:01,721 INFO [M:0;jenkins-hbase4:42625] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 14:13:01,721 DEBUG [M:0;jenkins-hbase4:42625] master.HMaster(1512): Stopping service threads 2023-07-19 14:13:01,722 INFO [M:0;jenkins-hbase4:42625] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 14:13:01,722 ERROR [M:0;jenkins-hbase4:42625] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 14:13:01,722 INFO [M:0;jenkins-hbase4:42625] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 14:13:01,722 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 14:13:01,775 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:01,775 INFO [RS:2;jenkins-hbase4:34233] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34233,1689775817080; zookeeper connection closed. 2023-07-19 14:13:01,775 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): regionserver:34233-0x1017deb3a810003, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:01,775 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4dc5fa67] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4dc5fa67 2023-07-19 14:13:01,775 INFO [Listener at jenkins-hbase4.apache.org/37607] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 14:13:01,790 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 14:13:01,791 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:13:01,791 DEBUG [M:0;jenkins-hbase4:42625] zookeeper.ZKUtil(398): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 14:13:01,791 WARN [M:0;jenkins-hbase4:42625] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 14:13:01,791 INFO [M:0;jenkins-hbase4:42625] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 14:13:01,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:13:01,791 INFO [M:0;jenkins-hbase4:42625] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 14:13:01,792 DEBUG [M:0;jenkins-hbase4:42625] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 14:13:01,792 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:13:01,792 DEBUG [M:0;jenkins-hbase4:42625] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:13:01,792 DEBUG [M:0;jenkins-hbase4:42625] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 14:13:01,792 DEBUG [M:0;jenkins-hbase4:42625] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:13:01,792 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.53 KB heapSize=451.72 KB 2023-07-19 14:13:01,842 INFO [M:0;jenkins-hbase4:42625] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.53 KB at sequenceid=898 (bloomFilter=true), to=hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/211c0e215df64fb782822bab86fcb776 2023-07-19 14:13:01,847 INFO [M:0;jenkins-hbase4:42625] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 211c0e215df64fb782822bab86fcb776 2023-07-19 14:13:01,848 DEBUG [M:0;jenkins-hbase4:42625] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/211c0e215df64fb782822bab86fcb776 as hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/211c0e215df64fb782822bab86fcb776 2023-07-19 14:13:01,853 INFO [M:0;jenkins-hbase4:42625] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 211c0e215df64fb782822bab86fcb776 2023-07-19 14:13:01,853 INFO [M:0;jenkins-hbase4:42625] regionserver.HStore(1080): Added hdfs://localhost:40027/user/jenkins/test-data/d26e05fa-09bc-722e-f1d6-bc44d8fdc4c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/211c0e215df64fb782822bab86fcb776, entries=119, sequenceid=898, filesize=28.7 K 2023-07-19 14:13:01,854 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegion(2948): Finished flush of dataSize ~375.53 KB/384541, heapSize ~451.70 KB/462544, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 62ms, sequenceid=898, compaction requested=false 2023-07-19 14:13:01,856 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:13:01,856 DEBUG [M:0;jenkins-hbase4:42625] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 14:13:01,861 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:13:01,861 INFO [M:0;jenkins-hbase4:42625] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 14:13:01,862 INFO [M:0;jenkins-hbase4:42625] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42625 2023-07-19 14:13:01,912 DEBUG [M:0;jenkins-hbase4:42625] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42625,1689775815479 already deleted, retry=false 2023-07-19 14:13:02,051 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:02,052 DEBUG [Listener at localhost/44257-EventThread] zookeeper.ZKWatcher(600): master:42625-0x1017deb3a810000, quorum=127.0.0.1:54361, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:13:02,051 INFO [M:0;jenkins-hbase4:42625] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42625,1689775815479; zookeeper connection closed. 2023-07-19 14:13:02,053 WARN [Listener at jenkins-hbase4.apache.org/37607] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 14:13:02,061 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:13:02,166 WARN [BP-1374738337-172.31.14.131-1689775811481 heartbeating to localhost/127.0.0.1:40027] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 14:13:02,166 WARN [BP-1374738337-172.31.14.131-1689775811481 heartbeating to localhost/127.0.0.1:40027] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1374738337-172.31.14.131-1689775811481 (Datanode Uuid 988124fc-ee99-451d-acbc-1a8337a67598) service to localhost/127.0.0.1:40027 2023-07-19 14:13:02,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data5/current/BP-1374738337-172.31.14.131-1689775811481] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:13:02,207 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data6/current/BP-1374738337-172.31.14.131-1689775811481] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:13:02,210 WARN [Listener at jenkins-hbase4.apache.org/37607] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 14:13:02,251 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:13:02,256 WARN [BP-1374738337-172.31.14.131-1689775811481 heartbeating to localhost/127.0.0.1:40027] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 14:13:02,256 WARN [BP-1374738337-172.31.14.131-1689775811481 heartbeating to localhost/127.0.0.1:40027] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1374738337-172.31.14.131-1689775811481 (Datanode Uuid 6e8b9358-7c08-4666-b8f9-66d91e86081f) service to localhost/127.0.0.1:40027 2023-07-19 14:13:02,257 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data3/current/BP-1374738337-172.31.14.131-1689775811481] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:13:02,257 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data4/current/BP-1374738337-172.31.14.131-1689775811481] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:13:02,258 WARN [Listener at jenkins-hbase4.apache.org/37607] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 14:13:02,277 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:13:02,381 WARN [BP-1374738337-172.31.14.131-1689775811481 heartbeating to localhost/127.0.0.1:40027] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 14:13:02,381 WARN [BP-1374738337-172.31.14.131-1689775811481 heartbeating to localhost/127.0.0.1:40027] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1374738337-172.31.14.131-1689775811481 (Datanode Uuid d5290ae6-2576-49ae-858d-a6e1053f51eb) service to localhost/127.0.0.1:40027 2023-07-19 14:13:02,382 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data1/current/BP-1374738337-172.31.14.131-1689775811481] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:13:02,383 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4e880ddf-057e-e6a2-0434-acd24b81f16c/cluster_84ab4f54-d490-ce71-0f4a-4569718cf175/dfs/data/data2/current/BP-1374738337-172.31.14.131-1689775811481] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:13:02,414 INFO [Listener at jenkins-hbase4.apache.org/37607] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:13:02,451 INFO [Listener at jenkins-hbase4.apache.org/37607] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 14:13:02,576 INFO [Listener at jenkins-hbase4.apache.org/37607] hbase.HBaseTestingUtility(1293): Minicluster is down