2023-07-11 15:29:16,707 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-11 15:29:16,976 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c 2023-07-11 15:29:16,977 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-11 15:29:16,977 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-11 15:29:17,014 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 15:29:17,244 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 15:29:17,245 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3, deleteOnExit=true 2023-07-11 15:29:17,245 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 15:29:17,246 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/test.cache.data in system properties and HBase conf 2023-07-11 15:29:17,246 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 15:29:17,247 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop.log.dir in system properties and HBase conf 2023-07-11 15:29:17,247 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 15:29:17,248 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 15:29:17,248 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 15:29:17,583 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 15:29:17,589 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 15:29:17,589 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 15:29:17,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 15:29:17,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 15:29:17,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 15:29:17,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 15:29:17,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 15:29:17,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 15:29:17,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 15:29:17,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/nfs.dump.dir in system properties and HBase conf 2023-07-11 15:29:17,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir in system properties and HBase conf 2023-07-11 15:29:17,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 15:29:17,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 15:29:17,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 15:29:18,204 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 15:29:18,208 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 15:29:18,515 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 15:29:18,711 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 15:29:18,730 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:18,777 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:18,829 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_localhost_39343_hdfs____iumrna/webapp 2023-07-11 15:29:19,006 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39343 2023-07-11 15:29:19,035 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 15:29:19,035 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 15:29:19,495 WARN [Listener at localhost/46655] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 15:29:19,600 WARN [Listener at localhost/46655] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 15:29:19,624 WARN [Listener at localhost/46655] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:19,633 INFO [Listener at localhost/46655] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:19,641 INFO [Listener at localhost/46655] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_localhost_33867_datanode____9pzzls/webapp 2023-07-11 15:29:19,772 INFO [Listener at localhost/46655] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33867 2023-07-11 15:29:20,344 WARN [Listener at localhost/34071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 15:29:20,372 WARN [Listener at localhost/34071] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 15:29:20,377 WARN [Listener at localhost/34071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:20,379 INFO [Listener at localhost/34071] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:20,386 INFO [Listener at localhost/34071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_localhost_37775_datanode____ne3ba0/webapp 2023-07-11 15:29:20,524 INFO [Listener at localhost/34071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37775 2023-07-11 15:29:20,549 WARN [Listener at localhost/35165] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 15:29:20,609 WARN [Listener at localhost/35165] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 15:29:20,612 WARN [Listener at localhost/35165] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:20,614 INFO [Listener at localhost/35165] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:20,626 INFO [Listener at localhost/35165] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_localhost_40365_datanode____diaof1/webapp 2023-07-11 15:29:20,815 INFO [Listener at localhost/35165] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40365 2023-07-11 15:29:20,850 WARN [Listener at localhost/34701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 15:29:21,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x153e11a470cd6eda: Processing first storage report for DS-3210cd95-92bb-49bb-8bb9-a3420542c242 from datanode fc83c3f1-13ad-4ade-9162-1e7b9de34d96 2023-07-11 15:29:21,059 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x153e11a470cd6eda: from storage DS-3210cd95-92bb-49bb-8bb9-a3420542c242 node DatanodeRegistration(127.0.0.1:39405, datanodeUuid=fc83c3f1-13ad-4ade-9162-1e7b9de34d96, infoPort=38933, infoSecurePort=0, ipcPort=34071, storageInfo=lv=-57;cid=testClusterID;nsid=513923314;c=1689089358278), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-11 15:29:21,069 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x153e11a470cd6eda: Processing first storage report for DS-edf16179-3f18-40b7-8346-9923eae5928b from datanode fc83c3f1-13ad-4ade-9162-1e7b9de34d96 2023-07-11 15:29:21,069 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x153e11a470cd6eda: from storage DS-edf16179-3f18-40b7-8346-9923eae5928b node DatanodeRegistration(127.0.0.1:39405, datanodeUuid=fc83c3f1-13ad-4ade-9162-1e7b9de34d96, infoPort=38933, infoSecurePort=0, ipcPort=34071, storageInfo=lv=-57;cid=testClusterID;nsid=513923314;c=1689089358278), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 15:29:21,070 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b6f0f24b20d87c0: Processing first storage report for DS-28877af3-7dc7-45e9-9283-e9d805d7c1df from datanode 40fce270-2a48-4f5c-b083-df49e44d50ad 2023-07-11 15:29:21,070 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b6f0f24b20d87c0: from storage DS-28877af3-7dc7-45e9-9283-e9d805d7c1df node DatanodeRegistration(127.0.0.1:46191, datanodeUuid=40fce270-2a48-4f5c-b083-df49e44d50ad, infoPort=45359, infoSecurePort=0, ipcPort=35165, storageInfo=lv=-57;cid=testClusterID;nsid=513923314;c=1689089358278), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 15:29:21,070 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b6f0f24b20d87c0: Processing first storage report for DS-6f308914-5bd4-4e7e-8e32-a0e04bb4644a from datanode 40fce270-2a48-4f5c-b083-df49e44d50ad 2023-07-11 15:29:21,071 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b6f0f24b20d87c0: from storage DS-6f308914-5bd4-4e7e-8e32-a0e04bb4644a node DatanodeRegistration(127.0.0.1:46191, datanodeUuid=40fce270-2a48-4f5c-b083-df49e44d50ad, infoPort=45359, infoSecurePort=0, ipcPort=35165, storageInfo=lv=-57;cid=testClusterID;nsid=513923314;c=1689089358278), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 15:29:21,109 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x633ea60897e00fa1: Processing first storage report for DS-d73ec024-dc76-4ce2-9174-faf33cc49288 from datanode eef31c97-ee6f-41e4-b8d0-42775983c7e7 2023-07-11 15:29:21,114 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x633ea60897e00fa1: from storage DS-d73ec024-dc76-4ce2-9174-faf33cc49288 node DatanodeRegistration(127.0.0.1:39005, datanodeUuid=eef31c97-ee6f-41e4-b8d0-42775983c7e7, infoPort=36331, infoSecurePort=0, ipcPort=34701, storageInfo=lv=-57;cid=testClusterID;nsid=513923314;c=1689089358278), blocks: 0, hasStaleStorage: true, processing time: 5 msecs, invalidatedBlocks: 0 2023-07-11 15:29:21,114 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x633ea60897e00fa1: Processing first storage report for DS-8e4a0a6d-6efd-4a59-b689-f6eae9a8fdd2 from datanode eef31c97-ee6f-41e4-b8d0-42775983c7e7 2023-07-11 15:29:21,115 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x633ea60897e00fa1: from storage DS-8e4a0a6d-6efd-4a59-b689-f6eae9a8fdd2 node DatanodeRegistration(127.0.0.1:39005, datanodeUuid=eef31c97-ee6f-41e4-b8d0-42775983c7e7, infoPort=36331, infoSecurePort=0, ipcPort=34701, storageInfo=lv=-57;cid=testClusterID;nsid=513923314;c=1689089358278), blocks: 0, hasStaleStorage: false, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 15:29:21,374 DEBUG [Listener at localhost/34701] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c 2023-07-11 15:29:21,449 INFO [Listener at localhost/34701] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/zookeeper_0, clientPort=55301, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 15:29:21,465 INFO [Listener at localhost/34701] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55301 2023-07-11 15:29:21,475 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:21,477 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:22,194 INFO [Listener at localhost/34701] util.FSUtils(471): Created version file at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 with version=8 2023-07-11 15:29:22,194 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/hbase-staging 2023-07-11 15:29:22,609 INFO [Listener at localhost/34701] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 15:29:23,209 INFO [Listener at localhost/34701] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 15:29:23,248 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,248 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,249 INFO [Listener at localhost/34701] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 15:29:23,249 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,249 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 15:29:23,403 INFO [Listener at localhost/34701] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 15:29:23,498 DEBUG [Listener at localhost/34701] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 15:29:23,609 INFO [Listener at localhost/34701] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35925 2023-07-11 15:29:23,628 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,631 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,657 INFO [Listener at localhost/34701] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35925 connecting to ZooKeeper ensemble=127.0.0.1:55301 2023-07-11 15:29:23,713 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:359250x0, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 15:29:23,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35925-0x10154f309b70000 connected 2023-07-11 15:29:23,746 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 15:29:23,747 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:29:23,767 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 15:29:23,776 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35925 2023-07-11 15:29:23,777 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35925 2023-07-11 15:29:23,779 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35925 2023-07-11 15:29:23,779 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35925 2023-07-11 15:29:23,779 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35925 2023-07-11 15:29:23,786 INFO [Listener at localhost/34701] master.HMaster(444): hbase.rootdir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, hbase.cluster.distributed=false 2023-07-11 15:29:23,865 INFO [Listener at localhost/34701] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 15:29:23,866 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,866 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,866 INFO [Listener at localhost/34701] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 15:29:23,866 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,867 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 15:29:23,873 INFO [Listener at localhost/34701] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 15:29:23,876 INFO [Listener at localhost/34701] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39487 2023-07-11 15:29:23,879 INFO [Listener at localhost/34701] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 15:29:23,887 INFO [Listener at localhost/34701] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 15:29:23,888 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,890 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,892 INFO [Listener at localhost/34701] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39487 connecting to ZooKeeper ensemble=127.0.0.1:55301 2023-07-11 15:29:23,898 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:394870x0, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 15:29:23,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39487-0x10154f309b70001 connected 2023-07-11 15:29:23,899 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 15:29:23,901 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:29:23,902 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 15:29:23,902 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39487 2023-07-11 15:29:23,903 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39487 2023-07-11 15:29:23,909 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39487 2023-07-11 15:29:23,911 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39487 2023-07-11 15:29:23,911 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39487 2023-07-11 15:29:23,924 INFO [Listener at localhost/34701] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 15:29:23,924 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,924 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,925 INFO [Listener at localhost/34701] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 15:29:23,925 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,926 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 15:29:23,926 INFO [Listener at localhost/34701] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 15:29:23,929 INFO [Listener at localhost/34701] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42251 2023-07-11 15:29:23,929 INFO [Listener at localhost/34701] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 15:29:23,931 INFO [Listener at localhost/34701] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 15:29:23,932 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,935 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,938 INFO [Listener at localhost/34701] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42251 connecting to ZooKeeper ensemble=127.0.0.1:55301 2023-07-11 15:29:23,944 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:422510x0, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 15:29:23,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42251-0x10154f309b70002 connected 2023-07-11 15:29:23,945 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 15:29:23,946 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:29:23,947 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 15:29:23,949 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42251 2023-07-11 15:29:23,950 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42251 2023-07-11 15:29:23,952 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42251 2023-07-11 15:29:23,955 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42251 2023-07-11 15:29:23,956 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42251 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 15:29:23,969 INFO [Listener at localhost/34701] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 15:29:23,971 INFO [Listener at localhost/34701] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33731 2023-07-11 15:29:23,971 INFO [Listener at localhost/34701] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 15:29:23,972 INFO [Listener at localhost/34701] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 15:29:23,973 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,974 INFO [Listener at localhost/34701] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:23,975 INFO [Listener at localhost/34701] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33731 connecting to ZooKeeper ensemble=127.0.0.1:55301 2023-07-11 15:29:23,983 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:337310x0, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 15:29:23,984 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:337310x0, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 15:29:23,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33731-0x10154f309b70003 connected 2023-07-11 15:29:23,985 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:29:23,986 DEBUG [Listener at localhost/34701] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 15:29:23,997 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33731 2023-07-11 15:29:23,998 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33731 2023-07-11 15:29:23,998 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33731 2023-07-11 15:29:23,999 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33731 2023-07-11 15:29:23,999 DEBUG [Listener at localhost/34701] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33731 2023-07-11 15:29:24,006 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:24,016 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 15:29:24,018 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:24,041 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 15:29:24,042 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 15:29:24,042 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 15:29:24,042 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 15:29:24,043 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:24,044 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 15:29:24,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 15:29:24,046 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35925,1689089362401 from backup master directory 2023-07-11 15:29:24,050 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:24,050 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 15:29:24,051 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 15:29:24,052 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:24,056 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 15:29:24,061 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 15:29:24,186 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/hbase.id with ID: 70dd73bf-fe60-4202-8729-d89283369c05 2023-07-11 15:29:24,238 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 15:29:24,257 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:24,318 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0f3537f9 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:24,367 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dafdc3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:24,396 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 15:29:24,398 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 15:29:24,423 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 15:29:24,423 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 15:29:24,426 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 15:29:24,431 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 15:29:24,433 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 15:29:24,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store-tmp 2023-07-11 15:29:24,526 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:24,527 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 15:29:24,527 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:29:24,527 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:29:24,527 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 15:29:24,527 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:29:24,527 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:29:24,528 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 15:29:24,529 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/WALs/jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:24,555 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35925%2C1689089362401, suffix=, logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/WALs/jenkins-hbase9.apache.org,35925,1689089362401, archiveDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/oldWALs, maxLogs=10 2023-07-11 15:29:24,627 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK] 2023-07-11 15:29:24,627 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK] 2023-07-11 15:29:24,627 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK] 2023-07-11 15:29:24,638 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 15:29:24,726 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/WALs/jenkins-hbase9.apache.org,35925,1689089362401/jenkins-hbase9.apache.org%2C35925%2C1689089362401.1689089364566 2023-07-11 15:29:24,729 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK], DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK], DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK]] 2023-07-11 15:29:24,730 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 15:29:24,732 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:24,735 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 15:29:24,736 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 15:29:24,815 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 15:29:24,823 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 15:29:24,859 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 15:29:24,873 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:24,880 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 15:29:24,882 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 15:29:24,896 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 15:29:24,901 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:24,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70050264, jitterRate=0.043830275535583496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:24,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 15:29:24,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 15:29:24,929 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 15:29:24,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 15:29:24,932 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 15:29:24,934 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 15:29:24,974 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 39 msec 2023-07-11 15:29:24,974 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 15:29:25,010 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 15:29:25,017 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 15:29:25,049 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 15:29:25,057 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 15:29:25,058 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 15:29:25,067 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 15:29:25,073 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 15:29:25,076 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:25,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 15:29:25,079 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 15:29:25,099 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 15:29:25,108 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 15:29:25,108 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 15:29:25,108 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:25,108 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 15:29:25,108 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 15:29:25,110 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,35925,1689089362401, sessionid=0x10154f309b70000, setting cluster-up flag (Was=false) 2023-07-11 15:29:25,135 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:25,146 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 15:29:25,151 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:25,160 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:25,167 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 15:29:25,168 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:25,171 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp 2023-07-11 15:29:25,209 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(951): ClusterId : 70dd73bf-fe60-4202-8729-d89283369c05 2023-07-11 15:29:25,225 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(951): ClusterId : 70dd73bf-fe60-4202-8729-d89283369c05 2023-07-11 15:29:25,222 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(951): ClusterId : 70dd73bf-fe60-4202-8729-d89283369c05 2023-07-11 15:29:25,238 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 15:29:25,239 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 15:29:25,239 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 15:29:25,251 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 15:29:25,251 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 15:29:25,252 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 15:29:25,252 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 15:29:25,253 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 15:29:25,253 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 15:29:25,259 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 15:29:25,261 DEBUG [RS:1;jenkins-hbase9:42251] zookeeper.ReadOnlyZKClient(139): Connect 0x43965a2a to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:25,265 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 15:29:25,265 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 15:29:25,271 DEBUG [RS:0;jenkins-hbase9:39487] zookeeper.ReadOnlyZKClient(139): Connect 0x7c0ba266 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:25,278 DEBUG [RS:2;jenkins-hbase9:33731] zookeeper.ReadOnlyZKClient(139): Connect 0x17c7a824 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:25,318 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-11 15:29:25,329 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:25,330 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-11 15:29:25,338 DEBUG [RS:1;jenkins-hbase9:42251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@694cc3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:25,340 DEBUG [RS:1;jenkins-hbase9:42251] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e48d955, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 15:29:25,350 DEBUG [RS:0;jenkins-hbase9:39487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@184ba75a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:25,351 DEBUG [RS:0;jenkins-hbase9:39487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1123cf70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 15:29:25,354 DEBUG [RS:2;jenkins-hbase9:33731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64111c21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:25,354 DEBUG [RS:2;jenkins-hbase9:33731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@266f6b4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 15:29:25,376 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:33731 2023-07-11 15:29:25,376 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:39487 2023-07-11 15:29:25,384 INFO [RS:2;jenkins-hbase9:33731] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 15:29:25,384 INFO [RS:2;jenkins-hbase9:33731] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 15:29:25,385 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 15:29:25,388 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:42251 2023-07-11 15:29:25,389 INFO [RS:1;jenkins-hbase9:42251] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 15:29:25,389 INFO [RS:1;jenkins-hbase9:42251] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 15:29:25,389 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 15:29:25,384 INFO [RS:0;jenkins-hbase9:39487] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 15:29:25,390 INFO [RS:0;jenkins-hbase9:39487] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 15:29:25,389 INFO [RS:1;jenkins-hbase9:42251] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:25,390 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 15:29:25,390 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 15:29:25,390 INFO [RS:2;jenkins-hbase9:33731] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:25,390 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 15:29:25,390 INFO [RS:0;jenkins-hbase9:39487] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:25,391 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 15:29:25,395 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35925,1689089362401 with isa=jenkins-hbase9.apache.org/172.31.2.10:33731, startcode=1689089363968 2023-07-11 15:29:25,395 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35925,1689089362401 with isa=jenkins-hbase9.apache.org/172.31.2.10:39487, startcode=1689089363864 2023-07-11 15:29:25,395 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35925,1689089362401 with isa=jenkins-hbase9.apache.org/172.31.2.10:42251, startcode=1689089363923 2023-07-11 15:29:25,422 DEBUG [RS:1;jenkins-hbase9:42251] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 15:29:25,423 DEBUG [RS:0;jenkins-hbase9:39487] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 15:29:25,422 DEBUG [RS:2;jenkins-hbase9:33731] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 15:29:25,453 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 15:29:25,478 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 15:29:25,478 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 15:29:25,478 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 15:29:25,478 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 15:29:25,478 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 15:29:25,479 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,479 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 15:29:25,479 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689089395510 2023-07-11 15:29:25,516 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 15:29:25,517 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 15:29:25,517 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 15:29:25,535 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 15:29:25,539 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 15:29:25,548 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 15:29:25,549 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 15:29:25,550 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 15:29:25,550 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 15:29:25,550 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48223, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 15:29:25,550 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38733, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 15:29:25,550 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40133, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 15:29:25,552 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,554 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 15:29:25,558 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 15:29:25,558 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 15:29:25,562 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 15:29:25,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 15:29:25,563 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35925] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 15:29:25,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689089365565,5,FailOnTimeoutGroup] 2023-07-11 15:29:25,568 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689089365568,5,FailOnTimeoutGroup] 2023-07-11 15:29:25,568 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,568 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 15:29:25,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,584 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35925] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,597 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35925] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,599 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:25,599 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:25,599 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46655 2023-07-11 15:29:25,600 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46655 2023-07-11 15:29:25,600 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 15:29:25,600 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 15:29:25,614 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:29:25,616 DEBUG [RS:1;jenkins-hbase9:42251] zookeeper.ZKUtil(162): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,616 DEBUG [RS:2;jenkins-hbase9:33731] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,616 WARN [RS:1;jenkins-hbase9:42251] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 15:29:25,616 WARN [RS:2;jenkins-hbase9:33731] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 15:29:25,620 INFO [RS:1;jenkins-hbase9:42251] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 15:29:25,630 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 15:29:25,630 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,630 WARN [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 15:29:25,620 INFO [RS:2;jenkins-hbase9:33731] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 15:29:25,635 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,638 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,42251,1689089363923] 2023-07-11 15:29:25,639 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,33731,1689089363968] 2023-07-11 15:29:25,646 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 15:29:25,647 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 15:29:25,647 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:25,649 DEBUG [RS:1;jenkins-hbase9:42251] zookeeper.ZKUtil(162): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,649 DEBUG [RS:2;jenkins-hbase9:33731] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,650 DEBUG [RS:2;jenkins-hbase9:33731] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,650 DEBUG [RS:1;jenkins-hbase9:42251] zookeeper.ZKUtil(162): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,669 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 15:29:25,669 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 15:29:25,693 INFO [RS:2;jenkins-hbase9:33731] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 15:29:25,693 INFO [RS:1;jenkins-hbase9:42251] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 15:29:25,722 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:25,726 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 15:29:25,729 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/info 2023-07-11 15:29:25,730 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 15:29:25,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:25,732 INFO [RS:2;jenkins-hbase9:33731] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 15:29:25,731 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35925,1689089362401 with isa=jenkins-hbase9.apache.org/172.31.2.10:39487, startcode=1689089363864 2023-07-11 15:29:25,732 INFO [RS:1;jenkins-hbase9:42251] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 15:29:25,742 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35925] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,748 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 15:29:25,749 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:25,749 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46655 2023-07-11 15:29:25,749 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 15:29:25,751 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:29:25,751 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:29:25,751 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:29:25,752 INFO [RS:1;jenkins-hbase9:42251] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 15:29:25,752 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,752 INFO [RS:2;jenkins-hbase9:33731] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 15:29:25,758 DEBUG [RS:0;jenkins-hbase9:39487] zookeeper.ZKUtil(162): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,758 WARN [RS:0;jenkins-hbase9:39487] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 15:29:25,759 INFO [RS:0;jenkins-hbase9:39487] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 15:29:25,759 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,759 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/rep_barrier 2023-07-11 15:29:25,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,760 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 15:29:25,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,761 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 15:29:25,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:25,753 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,763 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39487,1689089363864] 2023-07-11 15:29:25,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 15:29:25,764 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 15:29:25,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,767 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/table 2023-07-11 15:29:25,767 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 15:29:25,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:25,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,775 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740 2023-07-11 15:29:25,775 DEBUG [RS:0;jenkins-hbase9:39487] zookeeper.ZKUtil(162): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,777 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,777 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,777 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,777 DEBUG [RS:0;jenkins-hbase9:39487] zookeeper.ZKUtil(162): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,778 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740 2023-07-11 15:29:25,778 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,777 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 15:29:25,778 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 15:29:25,779 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:2;jenkins-hbase9:33731] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,778 DEBUG [RS:0;jenkins-hbase9:39487] zookeeper.ZKUtil(162): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,779 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,779 DEBUG [RS:1;jenkins-hbase9:42251] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,781 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 15:29:25,782 INFO [RS:0;jenkins-hbase9:39487] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 15:29:25,783 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 15:29:25,785 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 15:29:25,791 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,791 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,791 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,825 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,826 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,826 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,839 INFO [RS:0;jenkins-hbase9:39487] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 15:29:25,847 INFO [RS:0;jenkins-hbase9:39487] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 15:29:25,847 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,850 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 15:29:25,855 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,855 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:25,855 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,855 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,859 INFO [RS:1;jenkins-hbase9:42251] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 15:29:25,865 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,859 INFO [RS:2;jenkins-hbase9:33731] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 15:29:25,865 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,865 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,865 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66244413, jitterRate=-0.0128813236951828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 15:29:25,865 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 15:29:25,866 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,866 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,866 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 15:29:25,866 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,866 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 15:29:25,866 DEBUG [RS:0;jenkins-hbase9:39487] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 15:29:25,866 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 15:29:25,867 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 15:29:25,867 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 15:29:25,867 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 15:29:25,869 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33731,1689089363968-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,869 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42251,1689089363923-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,878 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,878 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,878 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,886 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 15:29:25,889 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 15:29:25,894 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 15:29:25,895 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 15:29:25,901 INFO [RS:0;jenkins-hbase9:39487] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 15:29:25,902 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39487,1689089363864-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:25,905 INFO [RS:1;jenkins-hbase9:42251] regionserver.Replication(203): jenkins-hbase9.apache.org,42251,1689089363923 started 2023-07-11 15:29:25,905 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,42251,1689089363923, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:42251, sessionid=0x10154f309b70002 2023-07-11 15:29:25,905 INFO [RS:2;jenkins-hbase9:33731] regionserver.Replication(203): jenkins-hbase9.apache.org,33731,1689089363968 started 2023-07-11 15:29:25,905 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 15:29:25,905 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,33731,1689089363968, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:33731, sessionid=0x10154f309b70003 2023-07-11 15:29:25,905 DEBUG [RS:1;jenkins-hbase9:42251] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,905 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 15:29:25,905 DEBUG [RS:1;jenkins-hbase9:42251] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42251,1689089363923' 2023-07-11 15:29:25,905 DEBUG [RS:2;jenkins-hbase9:33731] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 15:29:25,906 DEBUG [RS:1;jenkins-hbase9:42251] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 15:29:25,906 DEBUG [RS:2;jenkins-hbase9:33731] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33731,1689089363968' 2023-07-11 15:29:25,911 DEBUG [RS:2;jenkins-hbase9:33731] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 15:29:25,915 DEBUG [RS:2;jenkins-hbase9:33731] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 15:29:25,916 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 15:29:25,916 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 15:29:25,916 DEBUG [RS:2;jenkins-hbase9:33731] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:25,916 DEBUG [RS:2;jenkins-hbase9:33731] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33731,1689089363968' 2023-07-11 15:29:25,916 DEBUG [RS:2;jenkins-hbase9:33731] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:25,916 DEBUG [RS:2;jenkins-hbase9:33731] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:25,917 DEBUG [RS:2;jenkins-hbase9:33731] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 15:29:25,917 INFO [RS:2;jenkins-hbase9:33731] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 15:29:25,917 INFO [RS:2;jenkins-hbase9:33731] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 15:29:25,918 DEBUG [RS:1;jenkins-hbase9:42251] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 15:29:25,920 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 15:29:25,920 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 15:29:25,920 DEBUG [RS:1;jenkins-hbase9:42251] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:25,921 DEBUG [RS:1;jenkins-hbase9:42251] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42251,1689089363923' 2023-07-11 15:29:25,921 DEBUG [RS:1;jenkins-hbase9:42251] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:25,921 DEBUG [RS:1;jenkins-hbase9:42251] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:25,922 DEBUG [RS:1;jenkins-hbase9:42251] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 15:29:25,922 INFO [RS:1;jenkins-hbase9:42251] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 15:29:25,923 INFO [RS:1;jenkins-hbase9:42251] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 15:29:25,937 INFO [RS:0;jenkins-hbase9:39487] regionserver.Replication(203): jenkins-hbase9.apache.org,39487,1689089363864 started 2023-07-11 15:29:25,938 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 15:29:25,939 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,39487,1689089363864, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39487, sessionid=0x10154f309b70001 2023-07-11 15:29:25,939 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 15:29:25,939 DEBUG [RS:0;jenkins-hbase9:39487] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,939 DEBUG [RS:0;jenkins-hbase9:39487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39487,1689089363864' 2023-07-11 15:29:25,940 DEBUG [RS:0;jenkins-hbase9:39487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 15:29:25,942 DEBUG [RS:0;jenkins-hbase9:39487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 15:29:25,942 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 15:29:25,943 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 15:29:25,943 DEBUG [RS:0;jenkins-hbase9:39487] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:25,943 DEBUG [RS:0;jenkins-hbase9:39487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39487,1689089363864' 2023-07-11 15:29:25,943 DEBUG [RS:0;jenkins-hbase9:39487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:25,943 DEBUG [RS:0;jenkins-hbase9:39487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:25,944 DEBUG [RS:0;jenkins-hbase9:39487] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 15:29:25,944 INFO [RS:0;jenkins-hbase9:39487] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 15:29:25,944 INFO [RS:0;jenkins-hbase9:39487] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 15:29:25,946 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 15:29:26,030 INFO [RS:1;jenkins-hbase9:42251] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42251%2C1689089363923, suffix=, logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,42251,1689089363923, archiveDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs, maxLogs=32 2023-07-11 15:29:26,037 INFO [RS:2;jenkins-hbase9:33731] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33731%2C1689089363968, suffix=, logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,33731,1689089363968, archiveDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs, maxLogs=32 2023-07-11 15:29:26,047 INFO [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39487%2C1689089363864, suffix=, logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,39487,1689089363864, archiveDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs, maxLogs=32 2023-07-11 15:29:26,097 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK] 2023-07-11 15:29:26,102 DEBUG [jenkins-hbase9:35925] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 15:29:26,108 DEBUG [jenkins-hbase9:35925] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:29:26,128 DEBUG [jenkins-hbase9:35925] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:29:26,128 DEBUG [jenkins-hbase9:35925] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:29:26,128 DEBUG [jenkins-hbase9:35925] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:29:26,128 DEBUG [jenkins-hbase9:35925] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:29:26,132 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK] 2023-07-11 15:29:26,132 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK] 2023-07-11 15:29:26,140 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39487,1689089363864, state=OPENING 2023-07-11 15:29:26,143 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK] 2023-07-11 15:29:26,143 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK] 2023-07-11 15:29:26,143 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK] 2023-07-11 15:29:26,147 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK] 2023-07-11 15:29:26,147 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK] 2023-07-11 15:29:26,147 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK] 2023-07-11 15:29:26,152 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 15:29:26,154 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:26,154 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 15:29:26,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:29:26,162 INFO [RS:1;jenkins-hbase9:42251] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,42251,1689089363923/jenkins-hbase9.apache.org%2C42251%2C1689089363923.1689089366033 2023-07-11 15:29:26,171 DEBUG [RS:1;jenkins-hbase9:42251] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK], DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK], DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK]] 2023-07-11 15:29:26,172 INFO [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,39487,1689089363864/jenkins-hbase9.apache.org%2C39487%2C1689089363864.1689089366048 2023-07-11 15:29:26,173 DEBUG [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK], DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK], DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK]] 2023-07-11 15:29:26,179 INFO [RS:2;jenkins-hbase9:33731] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,33731,1689089363968/jenkins-hbase9.apache.org%2C33731%2C1689089363968.1689089366039 2023-07-11 15:29:26,181 DEBUG [RS:2;jenkins-hbase9:33731] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK], DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK], DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK]] 2023-07-11 15:29:26,364 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:26,367 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 15:29:26,371 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 15:29:26,388 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 15:29:26,388 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 15:29:26,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39487%2C1689089363864.meta, suffix=.meta, logDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,39487,1689089363864, archiveDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs, maxLogs=32 2023-07-11 15:29:26,432 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK] 2023-07-11 15:29:26,435 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK] 2023-07-11 15:29:26,438 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK] 2023-07-11 15:29:26,448 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/WALs/jenkins-hbase9.apache.org,39487,1689089363864/jenkins-hbase9.apache.org%2C39487%2C1689089363864.meta.1689089366398.meta 2023-07-11 15:29:26,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39405,DS-3210cd95-92bb-49bb-8bb9-a3420542c242,DISK], DatanodeInfoWithStorage[127.0.0.1:39005,DS-d73ec024-dc76-4ce2-9174-faf33cc49288,DISK], DatanodeInfoWithStorage[127.0.0.1:46191,DS-28877af3-7dc7-45e9-9283-e9d805d7c1df,DISK]] 2023-07-11 15:29:26,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 15:29:26,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-11 15:29:26,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:26,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 15:29:26,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 15:29:26,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 15:29:26,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 15:29:26,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:26,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 15:29:26,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 15:29:26,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 15:29:26,478 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/info 2023-07-11 15:29:26,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/info 2023-07-11 15:29:26,479 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 15:29:26,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:26,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 15:29:26,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/rep_barrier 2023-07-11 15:29:26,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/rep_barrier 2023-07-11 15:29:26,484 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 15:29:26,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:26,485 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 15:29:26,486 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/table 2023-07-11 15:29:26,486 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/table 2023-07-11 15:29:26,486 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 15:29:26,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:26,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740 2023-07-11 15:29:26,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740 2023-07-11 15:29:26,495 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 15:29:26,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 15:29:26,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70468573, jitterRate=0.050063565373420715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 15:29:26,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 15:29:26,519 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689089366355 2023-07-11 15:29:26,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 15:29:26,540 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 15:29:26,542 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,39487,1689089363864, state=OPEN 2023-07-11 15:29:26,545 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 15:29:26,545 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 15:29:26,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 15:29:26,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,39487,1689089363864 in 386 msec 2023-07-11 15:29:26,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 15:29:26,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 647 msec 2023-07-11 15:29:26,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2260 sec 2023-07-11 15:29:26,566 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689089366566, completionTime=-1 2023-07-11 15:29:26,567 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 15:29:26,567 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 15:29:26,657 DEBUG [hconnection-0x1744530a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:26,660 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:26,686 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 15:29:26,687 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689089426687 2023-07-11 15:29:26,687 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689089486687 2023-07-11 15:29:26,687 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-07-11 15:29:26,725 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35925,1689089362401-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:26,726 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35925,1689089362401-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:26,726 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35925,1689089362401-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:26,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35925, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:26,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 15:29:26,742 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 15:29:26,754 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 15:29:26,756 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 15:29:26,769 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 15:29:26,772 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:29:26,777 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:29:26,802 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:26,805 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd empty. 2023-07-11 15:29:26,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:26,806 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 15:29:26,852 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 15:29:26,854 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9ca21890ad83ba9c0679fa2a60fb3bd, NAME => 'hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:29:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c9ca21890ad83ba9c0679fa2a60fb3bd, disabling compactions & flushes 2023-07-11 15:29:26,887 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. after waiting 0 ms 2023-07-11 15:29:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:26,887 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:26,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c9ca21890ad83ba9c0679fa2a60fb3bd: 2023-07-11 15:29:26,892 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:29:26,910 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689089366896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089366896"}]},"ts":"1689089366896"} 2023-07-11 15:29:26,942 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 15:29:26,945 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:29:26,952 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089366945"}]},"ts":"1689089366945"} 2023-07-11 15:29:26,957 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 15:29:26,961 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:29:26,962 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:29:26,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:29:26,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:29:26,963 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:29:26,965 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c9ca21890ad83ba9c0679fa2a60fb3bd, ASSIGN}] 2023-07-11 15:29:26,969 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c9ca21890ad83ba9c0679fa2a60fb3bd, ASSIGN 2023-07-11 15:29:26,971 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c9ca21890ad83ba9c0679fa2a60fb3bd, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42251,1689089363923; forceNewPlan=false, retain=false 2023-07-11 15:29:27,123 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 15:29:27,124 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c9ca21890ad83ba9c0679fa2a60fb3bd, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:27,124 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689089367124"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089367124"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089367124"}]},"ts":"1689089367124"} 2023-07-11 15:29:27,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c9ca21890ad83ba9c0679fa2a60fb3bd, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:29:27,287 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:27,288 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 15:29:27,291 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 15:29:27,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:27,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9ca21890ad83ba9c0679fa2a60fb3bd, NAME => 'hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.', STARTKEY => '', ENDKEY => ''} 2023-07-11 15:29:27,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. service=AccessControlService 2023-07-11 15:29:27,298 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:27,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:27,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,301 INFO [StoreOpener-c9ca21890ad83ba9c0679fa2a60fb3bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,303 DEBUG [StoreOpener-c9ca21890ad83ba9c0679fa2a60fb3bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/info 2023-07-11 15:29:27,303 DEBUG [StoreOpener-c9ca21890ad83ba9c0679fa2a60fb3bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/info 2023-07-11 15:29:27,303 INFO [StoreOpener-c9ca21890ad83ba9c0679fa2a60fb3bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9ca21890ad83ba9c0679fa2a60fb3bd columnFamilyName info 2023-07-11 15:29:27,304 INFO [StoreOpener-c9ca21890ad83ba9c0679fa2a60fb3bd-1] regionserver.HStore(310): Store=c9ca21890ad83ba9c0679fa2a60fb3bd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:27,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,307 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:29:27,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:27,316 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c9ca21890ad83ba9c0679fa2a60fb3bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65399304, jitterRate=-0.0254744291305542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:27,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c9ca21890ad83ba9c0679fa2a60fb3bd: 2023-07-11 15:29:27,319 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd., pid=6, masterSystemTime=1689089367287 2023-07-11 15:29:27,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:27,323 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:29:27,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c9ca21890ad83ba9c0679fa2a60fb3bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:27,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689089367324"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089367324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089367324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089367324"}]},"ts":"1689089367324"} 2023-07-11 15:29:27,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 15:29:27,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c9ca21890ad83ba9c0679fa2a60fb3bd, server=jenkins-hbase9.apache.org,42251,1689089363923 in 195 msec 2023-07-11 15:29:27,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 15:29:27,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c9ca21890ad83ba9c0679fa2a60fb3bd, ASSIGN in 367 msec 2023-07-11 15:29:27,337 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:29:27,338 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089367338"}]},"ts":"1689089367338"} 2023-07-11 15:29:27,340 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 15:29:27,344 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:29:27,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 587 msec 2023-07-11 15:29:27,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 15:29:27,374 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 15:29:27,374 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:27,397 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:27,400 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:27,416 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 15:29:27,445 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 15:29:27,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-07-11 15:29:27,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 15:29:27,483 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 15:29:27,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 28 msec 2023-07-11 15:29:27,502 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 15:29:27,509 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 15:29:27,510 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.458sec 2023-07-11 15:29:27,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 15:29:27,514 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 15:29:27,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 15:29:27,516 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35925,1689089362401-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 15:29:27,517 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35925,1689089362401-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 15:29:27,527 DEBUG [Listener at localhost/34701] zookeeper.ReadOnlyZKClient(139): Connect 0x04d40e34 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:27,542 DEBUG [Listener at localhost/34701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95b019e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:27,547 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 15:29:27,552 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-11 15:29:27,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:29:27,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:29:27,561 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-11 15:29:27,567 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:27,568 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a empty. 2023-07-11 15:29:27,571 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:27,571 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-11 15:29:27,577 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 15:29:27,582 DEBUG [hconnection-0x789af62c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:27,613 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:27,614 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-11 15:29:27,616 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ed3660cccd1e7b944afc8c06ba03c59a, NAME => 'hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:29:27,617 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:29:27,617 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-11 15:29:27,617 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/test.cache.data in system properties and HBase conf 2023-07-11 15:29:27,617 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 15:29:27,617 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop.log.dir in system properties and HBase conf 2023-07-11 15:29:27,617 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 15:29:27,618 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/nfs.dump.dir in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 15:29:27,619 INFO [Listener at localhost/34701] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-11 15:29:27,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:27,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ed3660cccd1e7b944afc8c06ba03c59a, disabling compactions & flushes 2023-07-11 15:29:27,646 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:27,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:27,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. after waiting 0 ms 2023-07-11 15:29:27,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:27,646 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:27,646 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ed3660cccd1e7b944afc8c06ba03c59a: 2023-07-11 15:29:27,651 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:29:27,653 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689089367652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089367652"}]},"ts":"1689089367652"} 2023-07-11 15:29:27,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 15:29:27,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:29:27,662 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089367662"}]},"ts":"1689089367662"} 2023-07-11 15:29:27,664 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-11 15:29:27,668 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:29:27,669 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:29:27,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:29:27,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:29:27,670 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:29:27,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ed3660cccd1e7b944afc8c06ba03c59a, ASSIGN}] 2023-07-11 15:29:27,672 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ed3660cccd1e7b944afc8c06ba03c59a, ASSIGN 2023-07-11 15:29:27,674 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ed3660cccd1e7b944afc8c06ba03c59a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33731,1689089363968; forceNewPlan=false, retain=false 2023-07-11 15:29:27,685 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 15:29:27,860 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 15:29:27,861 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ed3660cccd1e7b944afc8c06ba03c59a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:27,862 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689089367861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089367861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089367861"}]},"ts":"1689089367861"} 2023-07-11 15:29:27,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ed3660cccd1e7b944afc8c06ba03c59a, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:29:27,885 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 15:29:28,036 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:28,036 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 15:29:28,038 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 15:29:28,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:28,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed3660cccd1e7b944afc8c06ba03c59a, NAME => 'hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 15:29:28,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. service=AccessControlService 2023-07-11 15:29:28,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:28,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:28,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,048 INFO [StoreOpener-ed3660cccd1e7b944afc8c06ba03c59a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,050 DEBUG [StoreOpener-ed3660cccd1e7b944afc8c06ba03c59a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/l 2023-07-11 15:29:28,050 DEBUG [StoreOpener-ed3660cccd1e7b944afc8c06ba03c59a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/l 2023-07-11 15:29:28,050 INFO [StoreOpener-ed3660cccd1e7b944afc8c06ba03c59a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed3660cccd1e7b944afc8c06ba03c59a columnFamilyName l 2023-07-11 15:29:28,051 INFO [StoreOpener-ed3660cccd1e7b944afc8c06ba03c59a-1] regionserver.HStore(310): Store=ed3660cccd1e7b944afc8c06ba03c59a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:28,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:29:28,065 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:28,066 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ed3660cccd1e7b944afc8c06ba03c59a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66276041, jitterRate=-0.012410029768943787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:28,067 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ed3660cccd1e7b944afc8c06ba03c59a: 2023-07-11 15:29:28,072 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a., pid=11, masterSystemTime=1689089368036 2023-07-11 15:29:28,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:28,081 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ed3660cccd1e7b944afc8c06ba03c59a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:28,081 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689089368081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089368081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089368081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089368081"}]},"ts":"1689089368081"} 2023-07-11 15:29:28,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:29:28,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 15:29:28,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ed3660cccd1e7b944afc8c06ba03c59a, server=jenkins-hbase9.apache.org,33731,1689089363968 in 208 msec 2023-07-11 15:29:28,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 15:29:28,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ed3660cccd1e7b944afc8c06ba03c59a, ASSIGN in 419 msec 2023-07-11 15:29:28,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:29:28,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089368096"}]},"ts":"1689089368096"} 2023-07-11 15:29:28,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-11 15:29:28,105 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:29:28,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 558 msec 2023-07-11 15:29:28,186 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 15:29:28,186 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-11 15:29:28,210 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 15:29:29,481 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:30,135 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:30,142 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_42213_jobhistory____.yo61d2/webapp 2023-07-11 15:29:30,522 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-11 15:29:30,522 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-11 15:29:30,522 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 15:29:30,525 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 15:29:30,615 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:30,954 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:31,343 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-11 15:29:31,393 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:42213 2023-07-11 15:29:32,178 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:29:32,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-11 15:29:32,459 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 15:29:32,461 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 15:29:32,472 WARN [Listener at jenkins-hbase9.apache.org/35079] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:32,594 WARN [Listener at jenkins-hbase9.apache.org/35079] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 15:29:32,595 INFO [Listener at jenkins-hbase9.apache.org/35079] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:32,601 INFO [Listener at jenkins-hbase9.apache.org/35079] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_39413_cluster____c05w55/webapp 2023-07-11 15:29:32,605 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:29:32,606 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-11 15:29:32,606 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:29:32,606 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-11 15:29:32,606 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 15:29:32,606 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-11 15:29:32,607 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:29:32,607 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-11 15:29:32,607 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 15:29:32,607 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 15:29:32,677 INFO [Listener at jenkins-hbase9.apache.org/35079] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 15:29:32,677 INFO [Listener at jenkins-hbase9.apache.org/35079] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-11 15:29:32,677 INFO [Listener at jenkins-hbase9.apache.org/35079] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 15:29:32,678 INFO [Listener at jenkins-hbase9.apache.org/35079] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 15:29:32,685 INFO [Listener at jenkins-hbase9.apache.org/35079] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:32,876 INFO [Listener at jenkins-hbase9.apache.org/35079] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:33,016 INFO [Listener at jenkins-hbase9.apache.org/35079] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:33,036 INFO [Listener at jenkins-hbase9.apache.org/35079] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:39413 2023-07-11 15:29:33,612 WARN [Listener at jenkins-hbase9.apache.org/45419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:33,642 WARN [Listener at jenkins-hbase9.apache.org/45419] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 15:29:33,643 INFO [Listener at jenkins-hbase9.apache.org/45419] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:33,652 INFO [Listener at jenkins-hbase9.apache.org/45419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_35243_node____.q568ig/webapp 2023-07-11 15:29:33,708 INFO [Listener at jenkins-hbase9.apache.org/45419] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 15:29:33,708 INFO [Listener at jenkins-hbase9.apache.org/45419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 15:29:33,708 INFO [Listener at jenkins-hbase9.apache.org/45419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 15:29:33,708 INFO [Listener at jenkins-hbase9.apache.org/45419] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 15:29:33,717 INFO [Listener at jenkins-hbase9.apache.org/45419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:33,745 INFO [Listener at jenkins-hbase9.apache.org/45419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:33,883 INFO [Listener at jenkins-hbase9.apache.org/45419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:33,902 INFO [Listener at jenkins-hbase9.apache.org/45419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:35243 2023-07-11 15:29:34,172 WARN [Listener at jenkins-hbase9.apache.org/40569] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 15:29:34,182 WARN [Listener at jenkins-hbase9.apache.org/40569] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 15:29:34,183 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 15:29:34,190 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_36233_node____.krbkuw/webapp 2023-07-11 15:29:34,244 INFO [Listener at jenkins-hbase9.apache.org/40569] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 15:29:34,244 INFO [Listener at jenkins-hbase9.apache.org/40569] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 15:29:34,245 INFO [Listener at jenkins-hbase9.apache.org/40569] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 15:29:34,245 INFO [Listener at jenkins-hbase9.apache.org/40569] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 15:29:34,255 INFO [Listener at jenkins-hbase9.apache.org/40569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:34,272 INFO [Listener at jenkins-hbase9.apache.org/40569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:34,364 INFO [Listener at jenkins-hbase9.apache.org/40569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 15:29:34,377 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:36233 2023-07-11 15:29:34,415 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-11 15:29:34,417 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:29:34,528 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=555, ProcessCount=172, AvailableMemoryMB=8485 2023-07-11 15:29:34,528 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-11 15:29:34,546 DEBUG [Listener at jenkins-hbase9.apache.org/40569] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 15:29:34,554 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 15:29:34,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 15:29:34,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:34,569 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:29:34,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-11 15:29:34,572 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:29:34,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 15:29:34,577 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:34,584 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d empty. 2023-07-11 15:29:34,584 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:34,587 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:34,587 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 empty. 2023-07-11 15:29:34,589 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:34,589 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 15:29:34,627 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-11 15:29:34,630 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => db10cc9bde00b17ad731ffcfaa26c79d, NAME => 'testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:29:34,630 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7403e1cbdb9885cefdfbd80301307e38, NAME => 'testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:29:34,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 15:29:34,699 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:34,700 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing db10cc9bde00b17ad731ffcfaa26c79d, disabling compactions & flushes 2023-07-11 15:29:34,700 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:34,700 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:34,700 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. after waiting 0 ms 2023-07-11 15:29:34,700 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:34,700 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:34,700 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for db10cc9bde00b17ad731ffcfaa26c79d: 2023-07-11 15:29:34,702 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:34,702 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 7403e1cbdb9885cefdfbd80301307e38, disabling compactions & flushes 2023-07-11 15:29:34,702 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:34,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:34,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. after waiting 0 ms 2023-07-11 15:29:34,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:34,703 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:34,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 7403e1cbdb9885cefdfbd80301307e38: 2023-07-11 15:29:34,706 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:29:34,708 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089374708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089374708"}]},"ts":"1689089374708"} 2023-07-11 15:29:34,708 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089374708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089374708"}]},"ts":"1689089374708"} 2023-07-11 15:29:34,757 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:29:34,758 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:29:34,759 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089374758"}]},"ts":"1689089374758"} 2023-07-11 15:29:34,762 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-11 15:29:34,767 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:29:34,769 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:29:34,769 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:29:34,769 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:29:34,769 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:29:34,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, ASSIGN}] 2023-07-11 15:29:34,773 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, ASSIGN 2023-07-11 15:29:34,773 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, ASSIGN 2023-07-11 15:29:34,775 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33731,1689089363968; forceNewPlan=false, retain=false 2023-07-11 15:29:34,775 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39487,1689089363864; forceNewPlan=false, retain=false 2023-07-11 15:29:34,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 15:29:34,925 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:29:34,927 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=db10cc9bde00b17ad731ffcfaa26c79d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:34,927 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7403e1cbdb9885cefdfbd80301307e38, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:34,928 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089374927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089374927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089374927"}]},"ts":"1689089374927"} 2023-07-11 15:29:34,928 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089374927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089374927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089374927"}]},"ts":"1689089374927"} 2023-07-11 15:29:34,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure db10cc9bde00b17ad731ffcfaa26c79d, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:29:34,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 7403e1cbdb9885cefdfbd80301307e38, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:29:35,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:35,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db10cc9bde00b17ad731ffcfaa26c79d, NAME => 'testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 15:29:35,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. service=AccessControlService 2023-07-11 15:29:35,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:35,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:35,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7403e1cbdb9885cefdfbd80301307e38, NAME => 'testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 15:29:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. service=AccessControlService 2023-07-11 15:29:35,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,096 INFO [StoreOpener-db10cc9bde00b17ad731ffcfaa26c79d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,102 INFO [StoreOpener-7403e1cbdb9885cefdfbd80301307e38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,103 DEBUG [StoreOpener-db10cc9bde00b17ad731ffcfaa26c79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf 2023-07-11 15:29:35,103 DEBUG [StoreOpener-db10cc9bde00b17ad731ffcfaa26c79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf 2023-07-11 15:29:35,104 DEBUG [StoreOpener-7403e1cbdb9885cefdfbd80301307e38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf 2023-07-11 15:29:35,104 DEBUG [StoreOpener-7403e1cbdb9885cefdfbd80301307e38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf 2023-07-11 15:29:35,107 INFO [StoreOpener-7403e1cbdb9885cefdfbd80301307e38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7403e1cbdb9885cefdfbd80301307e38 columnFamilyName cf 2023-07-11 15:29:35,107 INFO [StoreOpener-db10cc9bde00b17ad731ffcfaa26c79d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db10cc9bde00b17ad731ffcfaa26c79d columnFamilyName cf 2023-07-11 15:29:35,110 INFO [StoreOpener-db10cc9bde00b17ad731ffcfaa26c79d-1] regionserver.HStore(310): Store=db10cc9bde00b17ad731ffcfaa26c79d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:35,110 INFO [StoreOpener-7403e1cbdb9885cefdfbd80301307e38-1] regionserver.HStore(310): Store=7403e1cbdb9885cefdfbd80301307e38/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:35,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:35,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:35,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:35,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:35,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7403e1cbdb9885cefdfbd80301307e38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71164973, jitterRate=0.06044073402881622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:35,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7403e1cbdb9885cefdfbd80301307e38: 2023-07-11 15:29:35,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened db10cc9bde00b17ad731ffcfaa26c79d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59135965, jitterRate=-0.11880545318126678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:35,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for db10cc9bde00b17ad731ffcfaa26c79d: 2023-07-11 15:29:35,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38., pid=16, masterSystemTime=1689089375084 2023-07-11 15:29:35,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d., pid=15, masterSystemTime=1689089375083 2023-07-11 15:29:35,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:35,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:35,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7403e1cbdb9885cefdfbd80301307e38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:35,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089375135"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089375135"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089375135"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089375135"}]},"ts":"1689089375135"} 2023-07-11 15:29:35,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:35,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:35,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=db10cc9bde00b17ad731ffcfaa26c79d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:35,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089375137"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089375137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089375137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089375137"}]},"ts":"1689089375137"} 2023-07-11 15:29:35,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-11 15:29:35,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 7403e1cbdb9885cefdfbd80301307e38, server=jenkins-hbase9.apache.org,39487,1689089363864 in 211 msec 2023-07-11 15:29:35,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-11 15:29:35,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure db10cc9bde00b17ad731ffcfaa26c79d, server=jenkins-hbase9.apache.org,33731,1689089363968 in 215 msec 2023-07-11 15:29:35,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, ASSIGN in 377 msec 2023-07-11 15:29:35,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 15:29:35,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, ASSIGN in 379 msec 2023-07-11 15:29:35,155 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:29:35,155 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089375155"}]},"ts":"1689089375155"} 2023-07-11 15:29:35,157 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-11 15:29:35,170 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:29:35,177 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-11 15:29:35,184 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:35,187 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:35,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 15:29:35,192 DEBUG [hconnection-0x67639f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:35,196 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-11 15:29:35,207 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 15:29:35,240 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:35,240 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:35,240 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:35,240 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:35,240 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:29:35,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:35,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:35,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:35,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:35,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 685 msec 2023-07-11 15:29:35,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 15:29:35,690 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-11 15:29:35,694 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 15:29:35,696 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:35,698 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:29:35,723 DEBUG [hconnection-0x789af62c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:35,728 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:35,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 15:29:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089375746 (current time:1689089375746). 2023-07-11 15:29:35,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:29:35,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x4e020894 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:35,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62d68d74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:35,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:35,757 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:35,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e020894 to 127.0.0.1:55301 2023-07-11 15:29:35,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:35,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x11d7f99f to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:35,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5816c194, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:35,773 DEBUG [hconnection-0x1b1ca4e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:35,775 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:35,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:35,785 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:35,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11d7f99f to 127.0.0.1:55301 2023-07-11 15:29:35,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:35,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 15:29:35,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:29:35,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 15:29:35,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 15:29:35,841 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 15:29:35,846 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689089975846 2023-07-11 15:29:35,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 15:29:35,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 15:29:35,851 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 15:29:35,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 15:29:35,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:29:35,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:29:35,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-11 15:29:35,857 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 15:29:35,862 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689089975862 2023-07-11 15:29:35,955 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:35,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:35,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:35,960 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:29:36,160 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:36,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:36,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:36,162 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:29:36,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,304 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-11 15:29:36,304 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:36,304 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 15:29:36,304 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 15:29:36,305 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,305 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,309 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:36,309 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:36,309 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:36,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:36,309 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:36,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:36,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:36,310 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,310 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 15:29:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 15:29:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,312 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,312 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:29:36,312 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 15:29:36,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,312 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 15:29:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 15:29:36,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 15:29:36,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,316 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 15:29:36,316 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:36,316 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 15:29:36,316 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 15:29:36,318 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 15:29:36,319 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:36,319 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 15:29:36,319 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 15:29:36,319 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 15:29:36,321 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,322 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,322 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:36,324 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,324 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,324 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,324 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:36,324 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:36,324 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:36,324 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,325 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:36,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 15:29:36,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58bd021c[Count = 1] remaining members to acquire global barrier 2023-07-11 15:29:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:36,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 15:29:36,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58bd021c[Count = 0] remaining members to acquire global barrier 2023-07-11 15:29:36,330 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 15:29:36,330 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,332 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,332 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,332 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,333 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 15:29:36,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,333 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 15:29:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,333 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,333 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 15:29:36,333 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 15:29:36,333 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:29:36,333 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,333 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:29:36,334 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:36,334 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:36,334 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:36,334 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:36,334 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 15:29:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 15:29:36,336 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. started... 2023-07-11 15:29:36,336 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. started... 2023-07-11 15:29:36,340 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db10cc9bde00b17ad731ffcfaa26c79d: 2023-07-11 15:29:36,340 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7403e1cbdb9885cefdfbd80301307e38: 2023-07-11 15:29:36,341 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,341 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,347 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:36,347 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:36,351 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:29:36,351 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:29:36,389 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. completed. 2023-07-11 15:29:36,389 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:36,390 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:36,391 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:36,391 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,391 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 15:29:36,391 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:29:36,395 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:36,395 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 15:29:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:36,395 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:36,395 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 15:29:36,395 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. completed. 2023-07-11 15:29:36,396 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:36,396 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:36,397 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:36,397 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,397 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 15:29:36,397 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:29:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:36,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,400 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 15:29:36,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 15:29:36,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:36,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:29:36,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 15:29:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:36,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:36,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:36,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:36,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:29:36,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 15:29:36,409 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-11 15:29:36,409 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:29:36,409 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:29:36,409 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,409 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:36,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,412 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,412 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:36,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:36,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:36,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:36,413 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:36,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:36,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:36,414 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:36,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:36,417 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,417 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,417 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,431 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,431 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,431 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,431 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:36,432 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:36,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:36,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:36,431 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,432 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:36,432 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,432 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:36,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-11 15:29:36,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:36,432 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:36,432 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:36,432 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:36,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:29:36,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:36,433 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:36,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:36,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:36,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:36,433 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:36,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:36,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:36,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 15:29:36,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:36,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:36,462 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:36,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:36,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:36,464 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 15:29:36,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 15:29:36,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:36,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689089375847Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689089376465 (+618 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689089376465Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689089376465Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689089376494 (+29 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689089376548 (+54 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689089376602 (+54 ms) 2023-07-11 15:29:36,605 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 15:29:36,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 756 msec 2023-07-11 15:29:36,965 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:36,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:36,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:29:36,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33731] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:29:36,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39487] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:29:36,990 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 15:29:36,991 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:36,991 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:29:37,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 15:29:37,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089377008 (current time:1689089377008). 2023-07-11 15:29:37,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:29:37,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x427702e7 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:37,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18eb6c5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:37,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:37,020 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:37,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x427702e7 to 127.0.0.1:55301 2023-07-11 15:29:37,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:37,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x7294d8d2 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:37,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@80e8c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:37,031 DEBUG [hconnection-0x4bc4a8ba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:37,035 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:37,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:37,040 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:37,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7294d8d2 to 127.0.0.1:55301 2023-07-11 15:29:37,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:37,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 15:29:37,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:29:37,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 15:29:37,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 15:29:37,047 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 15:29:37,048 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689089977048 2023-07-11 15:29:37,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 15:29:37,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 15:29:37,049 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:29:37,049 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:29:37,051 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 15:29:37,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 15:29:37,053 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-11 15:29:37,054 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 15:29:37,062 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689089977062 2023-07-11 15:29:37,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-11 15:29:37,095 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-11 15:29:37,095 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:37,096 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 15:29:37,096 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 15:29:37,097 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,097 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,099 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:37,099 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,099 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:37,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:37,099 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:37,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:37,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:37,099 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,099 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,100 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,100 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:29:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 15:29:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,101 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 15:29:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 15:29:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 15:29:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 15:29:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 15:29:37,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 15:29:37,104 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 15:29:37,104 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:37,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 15:29:37,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 15:29:37,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 15:29:37,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 15:29:37,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 15:29:37,108 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 15:29:37,108 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:37,107 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 15:29:37,108 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:37,119 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 15:29:37,119 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 15:29:37,119 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 15:29:37,119 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 15:29:37,119 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 15:29:37,119 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 15:29:37,121 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,122 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,122 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:37,123 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,123 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:37,123 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,123 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,123 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:37,123 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:37,124 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,124 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:37,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:37,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 15:29:37,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73134361[Count = 1] remaining members to acquire global barrier 2023-07-11 15:29:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:37,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 15:29:37,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73134361[Count = 0] remaining members to acquire global barrier 2023-07-11 15:29:37,131 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 15:29:37,131 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,136 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,136 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,136 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 15:29:37,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:37,137 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:37,137 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:37,137 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:37,137 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. started... 2023-07-11 15:29:37,137 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,137 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. started... 2023-07-11 15:29:37,138 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing db10cc9bde00b17ad731ffcfaa26c79d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-11 15:29:37,138 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7403e1cbdb9885cefdfbd80301307e38 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-11 15:29:37,139 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,139 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:29:37,142 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 15:29:37,142 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:37,142 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 15:29:37,149 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:37,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:37,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:37,152 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:29:37,292 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071142727c31c55e4b7e9c59070fdb1616de to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071142727c31c55e4b7e9c59070fdb1616de 2023-07-11 15:29:37,292 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c20cac0ac4d74aebb9e708c871267f3f to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230711c20cac0ac4d74aebb9e708c871267f3f 2023-07-11 15:29:37,338 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/.tmp/cf/d9cf90e6dd394825ba4b0d95337bd125 2023-07-11 15:29:37,352 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/.tmp/cf/2542042f36f84bed83e482e95b6996f9 2023-07-11 15:29:37,353 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:37,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:37,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:37,360 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:29:37,360 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/.tmp/cf/d9cf90e6dd394825ba4b0d95337bd125 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf/d9cf90e6dd394825ba4b0d95337bd125 2023-07-11 15:29:37,372 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf/d9cf90e6dd394825ba4b0d95337bd125, entries=4, sequenceid=6, filesize=5.6 K 2023-07-11 15:29:37,373 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/.tmp/cf/2542042f36f84bed83e482e95b6996f9 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf/2542042f36f84bed83e482e95b6996f9 2023-07-11 15:29:37,377 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for db10cc9bde00b17ad731ffcfaa26c79d in 239ms, sequenceid=6, compaction requested=false 2023-07-11 15:29:37,377 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-11 15:29:37,378 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db10cc9bde00b17ad731ffcfaa26c79d: 2023-07-11 15:29:37,379 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 15:29:37,379 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:37,379 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf/d9cf90e6dd394825ba4b0d95337bd125] hfiles 2023-07-11 15:29:37,379 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf/d9cf90e6dd394825ba4b0d95337bd125 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 15:29:37,395 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf/2542042f36f84bed83e482e95b6996f9, entries=46, sequenceid=6, filesize=12.6 K 2023-07-11 15:29:37,404 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 7403e1cbdb9885cefdfbd80301307e38 in 266ms, sequenceid=6, compaction requested=false 2023-07-11 15:29:37,406 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7403e1cbdb9885cefdfbd80301307e38: 2023-07-11 15:29:37,407 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 15:29:37,407 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:37,407 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf/2542042f36f84bed83e482e95b6996f9] hfiles 2023-07-11 15:29:37,407 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf/2542042f36f84bed83e482e95b6996f9 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 15:29:37,491 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. completed. 2023-07-11 15:29:37,491 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:37,491 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:37,491 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:37,491 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,491 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 15:29:37,491 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:29:37,493 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 15:29:37,493 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:37,494 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 15:29:37,499 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:37,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:37,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:37,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:37,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:29:37,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 15:29:37,511 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. completed. 2023-07-11 15:29:37,511 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 15:29:37,511 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:29:37,513 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:37,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:37,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:37,517 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 15:29:37,517 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:37,517 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 15:29:37,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:29:37,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 15:29:37,521 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-11 15:29:37,521 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:29:37,521 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:29:37,521 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-11 15:29:37,522 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:29:37,526 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,526 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,526 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:37,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,526 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:37,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:37,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:37,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:37,527 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,527 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:37,527 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:37,534 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,535 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:37,535 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:37,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 15:29:37,538 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,539 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,539 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,571 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:37,571 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:37,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:37,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:37,571 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:37,571 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:37,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:37,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:37,574 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:37,574 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:37,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:37,574 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-11 15:29:37,574 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:37,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-11 15:29:37,574 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:37,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,577 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230711c20cac0ac4d74aebb9e708c871267f3f, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071142727c31c55e4b7e9c59070fdb1616de] mob files 2023-07-11 15:29:37,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230711c20cac0ac4d74aebb9e708c871267f3f 2023-07-11 15:29:37,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071142727c31c55e4b7e9c59070fdb1616de 2023-07-11 15:29:37,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-11 15:29:37,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,660 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:37,665 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 15:29:37,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 15:29:37,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,695 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 15:29:37,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689089377048Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689089377604 (+556 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689089377604Loading Region manifests for snaptb0-testExportWithTargetName at 1689089377604Writing data manifest for snaptb0-testExportWithTargetName at 1689089377612 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689089377632 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689089377694 (+62 ms) 2023-07-11 15:29:37,696 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 15:29:37,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 648 msec 2023-07-11 15:29:38,165 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:38,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 15:29:38,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:29:38,168 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168 2023-07-11 15:29:38,169 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46655, tgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168, rawTgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:38,208 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:38,208 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_441042735_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 15:29:38,208 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-11 15:29:38,227 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 15:29:38,312 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,313 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,313 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,314 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,314 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,315 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,315 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,412 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-7336732404836854617.jar 2023-07-11 15:29:38,413 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,414 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,414 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,415 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,415 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,415 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:38,416 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:29:38,416 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:29:38,417 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:29:38,417 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:29:38,418 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:29:38,418 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:29:38,419 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:29:38,419 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:29:38,419 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:29:38,420 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:29:38,423 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:38,423 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:38,424 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:29:38,424 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:38,424 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:38,425 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:29:38,425 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:29:39,371 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:29:39,377 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-11 15:29:39,385 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-11 15:29:39,841 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:29:39,843 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:29:40,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0001_000001 (auth:SIMPLE) 2023-07-11 15:29:40,608 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:29:45,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0001_000001 (auth:SIMPLE) 2023-07-11 15:29:47,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0001_000001 (auth:SIMPLE) 2023-07-11 15:29:51,195 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0001_000001 (auth:SIMPLE) 2023-07-11 15:29:53,244 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:29:53,247 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:29:53,259 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-11 15:29:53,259 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:29:53,260 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:29:53,260 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 15:29:53,261 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-11 15:29:53,261 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-11 15:29:53,261 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168/.hbase-snapshot/testExportWithTargetName 2023-07-11 15:29:53,261 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-11 15:29:53,261 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089378168/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-11 15:29:53,273 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-11 15:29:53,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-11 15:29:53,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,299 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089393299"}]},"ts":"1689089393299"} 2023-07-11 15:29:53,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 15:29:53,301 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-11 15:29:53,303 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-11 15:29:53,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, UNASSIGN}] 2023-07-11 15:29:53,308 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, UNASSIGN 2023-07-11 15:29:53,308 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, UNASSIGN 2023-07-11 15:29:53,311 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7403e1cbdb9885cefdfbd80301307e38, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:53,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=db10cc9bde00b17ad731ffcfaa26c79d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:53,311 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089393311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089393311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089393311"}]},"ts":"1689089393311"} 2023-07-11 15:29:53,312 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089393311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089393311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089393311"}]},"ts":"1689089393311"} 2023-07-11 15:29:53,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 7403e1cbdb9885cefdfbd80301307e38, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:29:53,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure db10cc9bde00b17ad731ffcfaa26c79d, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:29:53,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 15:29:53,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:53,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing db10cc9bde00b17ad731ffcfaa26c79d, disabling compactions & flushes 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7403e1cbdb9885cefdfbd80301307e38, disabling compactions & flushes 2023-07-11 15:29:53,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:53,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. after waiting 0 ms 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. after waiting 0 ms 2023-07-11 15:29:53,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:53,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:29:53,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:29:53,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:29:53,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:29:53,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d. 2023-07-11 15:29:53,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38. 2023-07-11 15:29:53,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for db10cc9bde00b17ad731ffcfaa26c79d: 2023-07-11 15:29:53,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7403e1cbdb9885cefdfbd80301307e38: 2023-07-11 15:29:53,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:53,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=db10cc9bde00b17ad731ffcfaa26c79d, regionState=CLOSED 2023-07-11 15:29:53,499 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089393499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089393499"}]},"ts":"1689089393499"} 2023-07-11 15:29:53,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:53,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=7403e1cbdb9885cefdfbd80301307e38, regionState=CLOSED 2023-07-11 15:29:53,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689089393500"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089393500"}]},"ts":"1689089393500"} 2023-07-11 15:29:53,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-11 15:29:53,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure db10cc9bde00b17ad731ffcfaa26c79d, server=jenkins-hbase9.apache.org,33731,1689089363968 in 187 msec 2023-07-11 15:29:53,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-11 15:29:53,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 7403e1cbdb9885cefdfbd80301307e38, server=jenkins-hbase9.apache.org,39487,1689089363864 in 190 msec 2023-07-11 15:29:53,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db10cc9bde00b17ad731ffcfaa26c79d, UNASSIGN in 199 msec 2023-07-11 15:29:53,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-11 15:29:53,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7403e1cbdb9885cefdfbd80301307e38, UNASSIGN in 201 msec 2023-07-11 15:29:53,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089393510"}]},"ts":"1689089393510"} 2023-07-11 15:29:53,512 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-11 15:29:53,513 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-11 15:29:53,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 231 msec 2023-07-11 15:29:53,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 15:29:53,604 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-11 15:29:53,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-11 15:29:53,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,622 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-11 15:29:53,625 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,629 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-11 15:29:53,638 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 15:29:53,638 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 15:29:53,638 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 15:29:53,638 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 15:29:53,642 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:53,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:53,642 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:53,643 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:53,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 15:29:53,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 15:29:53,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 15:29:53,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 15:29:53,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 15:29:53,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 15:29:53,643 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:53,644 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:53,645 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 15:29:53,645 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 15:29:53,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 15:29:53,647 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/recovered.edits] 2023-07-11 15:29:53,648 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/recovered.edits] 2023-07-11 15:29:53,656 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf/d9cf90e6dd394825ba4b0d95337bd125 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/cf/d9cf90e6dd394825ba4b0d95337bd125 2023-07-11 15:29:53,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf/2542042f36f84bed83e482e95b6996f9 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/cf/2542042f36f84bed83e482e95b6996f9 2023-07-11 15:29:53,662 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d/recovered.edits/9.seqid 2023-07-11 15:29:53,664 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/db10cc9bde00b17ad731ffcfaa26c79d 2023-07-11 15:29:53,666 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38/recovered.edits/9.seqid 2023-07-11 15:29:53,667 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportWithTargetName/7403e1cbdb9885cefdfbd80301307e38 2023-07-11 15:29:53,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 15:29:53,668 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-11 15:29:53,669 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-11 15:29:53,674 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230711c20cac0ac4d74aebb9e708c871267f3f to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230711c20cac0ac4d74aebb9e708c871267f3f 2023-07-11 15:29:53,676 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071142727c31c55e4b7e9c59070fdb1616de to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071142727c31c55e4b7e9c59070fdb1616de 2023-07-11 15:29:53,677 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-11 15:29:53,681 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,704 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-11 15:29:53,708 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-11 15:29:53,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-11 15:29:53,711 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089393711"}]},"ts":"9223372036854775807"} 2023-07-11 15:29:53,711 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089393711"}]},"ts":"9223372036854775807"} 2023-07-11 15:29:53,716 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 15:29:53,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => db10cc9bde00b17ad731ffcfaa26c79d, NAME => 'testtb-testExportWithTargetName,,1689089374562.db10cc9bde00b17ad731ffcfaa26c79d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7403e1cbdb9885cefdfbd80301307e38, NAME => 'testtb-testExportWithTargetName,1,1689089374562.7403e1cbdb9885cefdfbd80301307e38.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 15:29:53,716 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-11 15:29:53,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089393716"}]},"ts":"9223372036854775807"} 2023-07-11 15:29:53,719 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-11 15:29:53,721 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 15:29:53,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 110 msec 2023-07-11 15:29:53,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 15:29:53,750 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-11 15:29:53,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-11 15:29:53,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-11 15:29:53,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-11 15:29:53,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-11 15:29:53,806 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 707) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:44798 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1425191531_1 at /127.0.0.1:52320 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:60776 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1425191531_1 at /127.0.0.1:44270 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:44119 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:43882 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:36443 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=921 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=531 (was 555), ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6754 (was 8485) 2023-07-11 15:29:53,807 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-11 15:29:53,827 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=531, ProcessCount=178, AvailableMemoryMB=6754 2023-07-11 15:29:53,827 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-11 15:29:53,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 15:29:53,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:29:53,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:29:53,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-11 15:29:53,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:29:53,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 15:29:53,839 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:53,839 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:53,840 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f empty. 2023-07-11 15:29:53,840 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d empty. 2023-07-11 15:29:53,840 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:53,840 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:53,840 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 15:29:53,858 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 15:29:53,859 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d7ffd07bde1fec31cb7e119c5f2997f, NAME => 'testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:29:53,860 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 54197fa9522bcabf771740c550447b7d, NAME => 'testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:29:53,880 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:53,880 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 54197fa9522bcabf771740c550447b7d, disabling compactions & flushes 2023-07-11 15:29:53,880 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:53,880 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:53,880 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. after waiting 0 ms 2023-07-11 15:29:53,880 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:53,880 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:53,880 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 54197fa9522bcabf771740c550447b7d: 2023-07-11 15:29:53,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 15:29:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 15:29:54,280 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:54,281 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0d7ffd07bde1fec31cb7e119c5f2997f, disabling compactions & flushes 2023-07-11 15:29:54,281 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,281 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,281 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. after waiting 0 ms 2023-07-11 15:29:54,281 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,281 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,281 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0d7ffd07bde1fec31cb7e119c5f2997f: 2023-07-11 15:29:54,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:29:54,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089394285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089394285"}]},"ts":"1689089394285"} 2023-07-11 15:29:54,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089394285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089394285"}]},"ts":"1689089394285"} 2023-07-11 15:29:54,288 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:29:54,289 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:29:54,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089394289"}]},"ts":"1689089394289"} 2023-07-11 15:29:54,291 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 15:29:54,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:29:54,295 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:29:54,295 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:29:54,296 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:29:54,296 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:29:54,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, ASSIGN}] 2023-07-11 15:29:54,299 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, ASSIGN 2023-07-11 15:29:54,300 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, ASSIGN 2023-07-11 15:29:54,301 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42251,1689089363923; forceNewPlan=false, retain=false 2023-07-11 15:29:54,301 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39487,1689089363864; forceNewPlan=false, retain=false 2023-07-11 15:29:54,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 15:29:54,452 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:29:54,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=54197fa9522bcabf771740c550447b7d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:54,455 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0d7ffd07bde1fec31cb7e119c5f2997f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:54,455 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089394455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089394455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089394455"}]},"ts":"1689089394455"} 2023-07-11 15:29:54,456 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089394455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089394455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089394455"}]},"ts":"1689089394455"} 2023-07-11 15:29:54,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 54197fa9522bcabf771740c550447b7d, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:29:54,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 0d7ffd07bde1fec31cb7e119c5f2997f, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:29:54,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:54,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 54197fa9522bcabf771740c550447b7d, NAME => 'testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 15:29:54,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. service=AccessControlService 2023-07-11 15:29:54,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:54,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:54,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,627 INFO [StoreOpener-54197fa9522bcabf771740c550447b7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d7ffd07bde1fec31cb7e119c5f2997f, NAME => 'testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 15:29:54,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. service=AccessControlService 2023-07-11 15:29:54,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:29:54,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:29:54,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,629 DEBUG [StoreOpener-54197fa9522bcabf771740c550447b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf 2023-07-11 15:29:54,629 DEBUG [StoreOpener-54197fa9522bcabf771740c550447b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf 2023-07-11 15:29:54,629 INFO [StoreOpener-54197fa9522bcabf771740c550447b7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54197fa9522bcabf771740c550447b7d columnFamilyName cf 2023-07-11 15:29:54,629 INFO [StoreOpener-0d7ffd07bde1fec31cb7e119c5f2997f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,631 INFO [StoreOpener-54197fa9522bcabf771740c550447b7d-1] regionserver.HStore(310): Store=54197fa9522bcabf771740c550447b7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:54,631 DEBUG [StoreOpener-0d7ffd07bde1fec31cb7e119c5f2997f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf 2023-07-11 15:29:54,632 DEBUG [StoreOpener-0d7ffd07bde1fec31cb7e119c5f2997f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf 2023-07-11 15:29:54,632 INFO [StoreOpener-0d7ffd07bde1fec31cb7e119c5f2997f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d7ffd07bde1fec31cb7e119c5f2997f columnFamilyName cf 2023-07-11 15:29:54,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,633 INFO [StoreOpener-0d7ffd07bde1fec31cb7e119c5f2997f-1] regionserver.HStore(310): Store=0d7ffd07bde1fec31cb7e119c5f2997f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:29:54,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 54197fa9522bcabf771740c550447b7d 2023-07-11 15:29:54,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:29:54,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:54,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 54197fa9522bcabf771740c550447b7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69306630, jitterRate=0.03274926543235779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:54,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 54197fa9522bcabf771740c550447b7d: 2023-07-11 15:29:54,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d., pid=30, masterSystemTime=1689089394617 2023-07-11 15:29:54,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:29:54,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0d7ffd07bde1fec31cb7e119c5f2997f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72362875, jitterRate=0.07829086482524872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:29:54,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0d7ffd07bde1fec31cb7e119c5f2997f: 2023-07-11 15:29:54,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f., pid=31, masterSystemTime=1689089394619 2023-07-11 15:29:54,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:54,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:54,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=54197fa9522bcabf771740c550447b7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:54,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089394644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089394644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089394644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089394644"}]},"ts":"1689089394644"} 2023-07-11 15:29:54,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0d7ffd07bde1fec31cb7e119c5f2997f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:54,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089394645"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089394645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089394645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089394645"}]},"ts":"1689089394645"} 2023-07-11 15:29:54,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-11 15:29:54,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 54197fa9522bcabf771740c550447b7d, server=jenkins-hbase9.apache.org,39487,1689089363864 in 192 msec 2023-07-11 15:29:54,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-11 15:29:54,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 0d7ffd07bde1fec31cb7e119c5f2997f, server=jenkins-hbase9.apache.org,42251,1689089363923 in 186 msec 2023-07-11 15:29:54,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, ASSIGN in 357 msec 2023-07-11 15:29:54,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-11 15:29:54,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, ASSIGN in 360 msec 2023-07-11 15:29:54,661 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:29:54,661 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089394661"}]},"ts":"1689089394661"} 2023-07-11 15:29:54,662 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 15:29:54,665 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:29:54,666 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-11 15:29:54,668 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 15:29:54,671 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:54,671 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:54,671 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:54,671 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:29:54,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:54,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:54,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:54,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:29:54,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 842 msec 2023-07-11 15:29:54,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 15:29:54,943 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-11 15:29:54,946 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 15:29:54,946 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:54,949 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:29:54,958 DEBUG [hconnection-0x789af62c-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:54,961 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:54,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:29:54,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089394968 (current time:1689089394968). 2023-07-11 15:29:54,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:29:54,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x0b234d65 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:54,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@306a03e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:54,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:54,978 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:54,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b234d65 to 127.0.0.1:55301 2023-07-11 15:29:54,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:54,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x62cb658a to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:54,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739244d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:54,986 DEBUG [hconnection-0x13872c50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:54,988 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:54,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:54,994 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:54,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62cb658a to 127.0.0.1:55301 2023-07-11 15:29:54,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:54,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 15:29:54,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:29:54,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:29:54,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:29:54,999 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:29:55,000 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689089995000 2023-07-11 15:29:55,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 15:29:55,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:29:55,002 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:29:55,002 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:29:55,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 15:29:55,003 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:29:55,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-11 15:29:55,006 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 15:29:55,006 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689089995006 2023-07-11 15:29:55,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,020 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-11 15:29:55,020 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:55,022 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 15:29:55,022 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 15:29:55,022 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,022 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,023 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:55,023 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:55,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:55,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:55,023 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,023 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:55,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,024 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,024 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,025 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,025 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 15:29:55,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 15:29:55,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,026 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 15:29:55,026 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:55,026 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 15:29:55,027 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 15:29:55,027 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 15:29:55,027 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 15:29:55,026 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 15:29:55,027 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:55,027 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:55,029 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 15:29:55,030 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 15:29:55,030 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 15:29:55,030 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 15:29:55,030 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 15:29:55,030 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 15:29:55,032 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,032 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:55,039 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,040 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:55,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,040 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:55,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12724492[Count = 1] remaining members to acquire global barrier 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:55,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:55,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 15:29:55,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12724492[Count = 0] remaining members to acquire global barrier 2023-07-11 15:29:55,050 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 15:29:55,050 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:29:55,052 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:29:55,052 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,052 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:55,052 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:55,053 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:55,053 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. started... 2023-07-11 15:29:55,055 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:55,055 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:55,055 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:55,055 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 54197fa9522bcabf771740c550447b7d: 2023-07-11 15:29:55,055 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. started... 2023-07-11 15:29:55,055 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d7ffd07bde1fec31cb7e119c5f2997f: 2023-07-11 15:29:55,055 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,056 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:55,056 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:29:55,056 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,056 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:55,056 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:29:55,056 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 15:29:55,056 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:55,056 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 15:29:55,103 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:55,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:29:55,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:55,105 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:29:55,106 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. completed. 2023-07-11 15:29:55,106 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:55,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:55,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:55,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 15:29:55,107 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:29:55,110 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 15:29:55,110 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,110 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:55,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,110 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 15:29:55,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:55,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:55,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:55,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:55,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:55,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:29:55,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 15:29:55,305 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:55,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:29:55,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:55,307 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:29:55,507 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. completed. 2023-07-11 15:29:55,507 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:55,507 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:55,507 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:55,507 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,507 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 15:29:55,507 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:29:55,509 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 15:29:55,509 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:55,509 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,509 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 15:29:55,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:55,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:55,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:29:55,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 15:29:55,517 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-11 15:29:55,517 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:29:55,517 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:29:55,517 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,517 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:29:55,519 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:55,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,519 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:55,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,520 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:55,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:55,521 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:55,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,521 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:55,522 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:55,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,526 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,526 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,527 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,545 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:55,545 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:55,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:55,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:55,546 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:55,546 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:55,546 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:55,546 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:55,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:55,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:55,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:55,547 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:55,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:55,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:55,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,547 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,548 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-11 15:29:55,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:29:55,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:55,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 15:29:55,550 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:55,553 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:55,554 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,554 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,607 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:55,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:29:55,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:55,609 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 15:29:55,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 15:29:55,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,640 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 15:29:55,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689089395001Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689089395573 (+572 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689089395573Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689089395573Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689089395578 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689089395602 (+24 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689089395639 (+37 ms) 2023-07-11 15:29:55,642 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 15:29:55,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 641 msec 2023-07-11 15:29:56,109 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:56,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:29:56,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:29:56,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42251] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:29:56,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39487] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:29:56,120 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 15:29:56,120 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:56,121 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:29:56,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:29:56,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089396134 (current time:1689089396134). 2023-07-11 15:29:56,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:29:56,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x6b67ff87 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:56,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6adb6415, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:56,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:56,151 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:56,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b67ff87 to 127.0.0.1:55301 2023-07-11 15:29:56,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:56,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x20a4a42d to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:29:56,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4521d53d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:29:56,262 DEBUG [hconnection-0x340bb20f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:56,264 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:56,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:29:56,272 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:29:56,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20a4a42d to 127.0.0.1:55301 2023-07-11 15:29:56,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:29:56,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 15:29:56,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:29:56,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:29:56,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:29:56,278 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:29:56,279 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689089996279 2023-07-11 15:29:56,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:29:56,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 15:29:56,280 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:29:56,280 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:29:56,281 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:29:56,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 15:29:56,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-11 15:29:56,283 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 15:29:56,284 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689089996284 2023-07-11 15:29:56,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-11 15:29:56,294 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-11 15:29:56,294 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:56,296 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 15:29:56,296 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 15:29:56,296 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,296 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,297 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:56,297 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:56,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:56,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:56,298 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,297 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:56,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:56,298 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,298 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,299 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 15:29:56,300 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 15:29:56,300 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:56,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 15:29:56,301 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 15:29:56,301 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 15:29:56,301 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:56,301 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 15:29:56,302 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 15:29:56,302 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 15:29:56,302 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 15:29:56,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 15:29:56,302 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 15:29:56,302 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 15:29:56,302 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:29:56,303 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 15:29:56,303 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 15:29:56,303 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 15:29:56,304 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,305 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,305 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:56,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:56,306 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,306 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,306 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,306 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:56,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:56,306 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,307 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:56,307 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,307 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:29:56,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:56,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b1315f6[Count = 1] remaining members to acquire global barrier 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:56,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:56,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 15:29:56,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b1315f6[Count = 0] remaining members to acquire global barrier 2023-07-11 15:29:56,311 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 15:29:56,311 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:29:56,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:29:56,313 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,313 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:29:56,313 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:56,313 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:29:56,313 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. started... 2023-07-11 15:29:56,313 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. started... 2023-07-11 15:29:56,313 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,313 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:29:56,314 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 54197fa9522bcabf771740c550447b7d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 15:29:56,314 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d7ffd07bde1fec31cb7e119c5f2997f 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 15:29:56,314 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 15:29:56,314 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:56,314 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 15:29:56,336 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711ccee46a4b85c47559f06a3e352f4c67f to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ccee46a4b85c47559f06a3e352f4c67f 2023-07-11 15:29:56,341 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711b4edbaf2a8a547fb934f1b6671c7779c to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230711b4edbaf2a8a547fb934f1b6671c7779c 2023-07-11 15:29:56,346 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/.tmp/cf/9abac28e5226430bb4b19048e1c1bcde 2023-07-11 15:29:56,352 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/.tmp/cf/4e83cd7fc09f4c89a0e5603f69ee6032 2023-07-11 15:29:56,353 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/.tmp/cf/9abac28e5226430bb4b19048e1c1bcde as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf/9abac28e5226430bb4b19048e1c1bcde 2023-07-11 15:29:56,358 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/.tmp/cf/4e83cd7fc09f4c89a0e5603f69ee6032 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf/4e83cd7fc09f4c89a0e5603f69ee6032 2023-07-11 15:29:56,359 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf/9abac28e5226430bb4b19048e1c1bcde, entries=3, sequenceid=6, filesize=5.4 K 2023-07-11 15:29:56,360 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0d7ffd07bde1fec31cb7e119c5f2997f in 46ms, sequenceid=6, compaction requested=false 2023-07-11 15:29:56,360 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-11 15:29:56,360 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d7ffd07bde1fec31cb7e119c5f2997f: 2023-07-11 15:29:56,361 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 15:29:56,361 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:56,361 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf/9abac28e5226430bb4b19048e1c1bcde] hfiles 2023-07-11 15:29:56,361 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf/9abac28e5226430bb4b19048e1c1bcde for snapshot=snaptb0-testExportFileSystemState 2023-07-11 15:29:56,364 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf/4e83cd7fc09f4c89a0e5603f69ee6032, entries=47, sequenceid=6, filesize=12.8 K 2023-07-11 15:29:56,365 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 54197fa9522bcabf771740c550447b7d in 52ms, sequenceid=6, compaction requested=false 2023-07-11 15:29:56,367 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 54197fa9522bcabf771740c550447b7d: 2023-07-11 15:29:56,367 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 15:29:56,367 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:29:56,367 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf/4e83cd7fc09f4c89a0e5603f69ee6032] hfiles 2023-07-11 15:29:56,367 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf/4e83cd7fc09f4c89a0e5603f69ee6032 for snapshot=snaptb0-testExportFileSystemState 2023-07-11 15:29:56,371 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. completed. 2023-07-11 15:29:56,371 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:29:56,371 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:56,371 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:56,371 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,371 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 15:29:56,371 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:29:56,377 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. completed. 2023-07-11 15:29:56,377 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 15:29:56,377 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,377 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:29:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:56,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:29:56,378 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 15:29:56,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:56,380 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:56,380 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 15:29:56,380 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,380 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:56,381 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 15:29:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:29:56,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:29:56,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,382 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:29:56,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:56,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:29:56,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 15:29:56,390 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-11 15:29:56,390 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:29:56,390 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:29:56,390 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-11 15:29:56,390 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:56,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:56,392 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:29:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:29:56,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:56,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:56,393 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:56,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:56,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:56,394 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:29:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,395 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:29:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,397 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:29:56,397 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 15:29:56,398 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,401 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,401 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,401 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,401 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:29:56,402 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:56,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,403 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:29:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:56,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:56,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-11 15:29:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:56,404 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:29:56,403 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:29:56,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:29:56,404 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:29:56,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-11 15:29:56,404 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:29:56,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 15:29:56,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:29:56,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:56,404 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:56,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230711b4edbaf2a8a547fb934f1b6671c7779c, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ccee46a4b85c47559f06a3e352f4c67f] mob files 2023-07-11 15:29:56,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:29:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:29:56,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230711b4edbaf2a8a547fb934f1b6671c7779c 2023-07-11 15:29:56,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ccee46a4b85c47559f06a3e352f4c67f 2023-07-11 15:29:56,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-11 15:29:56,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 15:29:56,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,460 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689089396279Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689089396414 (+135 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689089396414Loading Region manifests for snaptb0-testExportFileSystemState at 1689089396414Writing data manifest for snaptb0-testExportFileSystemState at 1689089396418 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689089396426 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689089396460 (+34 ms) 2023-07-11 15:29:56,463 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 15:29:56,465 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 183 msec 2023-07-11 15:29:56,582 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:29:56,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:29:56,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:29:56,584 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584 2023-07-11 15:29:56,584 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46655, tgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584, rawTgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:56,607 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:29:56,607 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-775114469_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,608 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-11 15:29:56,622 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 15:29:56,645 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,646 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,646 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,646 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,647 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,647 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,647 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,719 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-8431599675209269729.jar 2023-07-11 15:29:56,720 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,720 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,721 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,721 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,722 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,722 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:29:56,722 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:29:56,723 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:29:56,723 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:29:56,724 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:29:56,724 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:29:56,725 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:29:56,725 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:29:56,726 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:29:56,726 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:29:56,727 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:29:56,727 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:56,728 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:56,728 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:29:56,728 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:56,729 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:29:56,729 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:29:56,730 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:29:57,170 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:29:57,173 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-11 15:29:57,176 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-11 15:29:57,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:29:57,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:29:57,309 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0001_000001 (auth:SIMPLE) 2023-07-11 15:29:57,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0002_000001 (auth:SIMPLE) 2023-07-11 15:29:59,106 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:30:02,146 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0002_000001 (auth:SIMPLE) 2023-07-11 15:30:04,406 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0002_000001 (auth:SIMPLE) 2023-07-11 15:30:08,212 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0002_000001 (auth:SIMPLE) 2023-07-11 15:30:09,425 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:30:09,427 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:30:09,436 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-11 15:30:09,436 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:30:09,437 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:30:09,437 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 15:30:09,438 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 15:30:09,438 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 15:30:09,438 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 15:30:09,439 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 15:30:09,439 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089396584/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 15:30:09,447 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-11 15:30:09,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-11 15:30:09,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,454 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089409453"}]},"ts":"1689089409453"} 2023-07-11 15:30:09,455 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 15:30:09,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 15:30:09,457 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-11 15:30:09,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, UNASSIGN}] 2023-07-11 15:30:09,460 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, UNASSIGN 2023-07-11 15:30:09,460 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, UNASSIGN 2023-07-11 15:30:09,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0d7ffd07bde1fec31cb7e119c5f2997f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:09,462 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089409461"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089409461"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089409461"}]},"ts":"1689089409461"} 2023-07-11 15:30:09,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=54197fa9522bcabf771740c550447b7d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:09,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089409462"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089409462"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089409462"}]},"ts":"1689089409462"} 2023-07-11 15:30:09,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 0d7ffd07bde1fec31cb7e119c5f2997f, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:30:09,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 54197fa9522bcabf771740c550447b7d, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:30:09,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 15:30:09,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 54197fa9522bcabf771740c550447b7d 2023-07-11 15:30:09,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:30:09,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 54197fa9522bcabf771740c550447b7d, disabling compactions & flushes 2023-07-11 15:30:09,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0d7ffd07bde1fec31cb7e119c5f2997f, disabling compactions & flushes 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:30:09,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. after waiting 0 ms 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. after waiting 0 ms 2023-07-11 15:30:09,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:30:09,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:30:09,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:30:09,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:30:09,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:30:09,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f. 2023-07-11 15:30:09,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d. 2023-07-11 15:30:09,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 54197fa9522bcabf771740c550447b7d: 2023-07-11 15:30:09,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0d7ffd07bde1fec31cb7e119c5f2997f: 2023-07-11 15:30:09,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 54197fa9522bcabf771740c550447b7d 2023-07-11 15:30:09,636 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=54197fa9522bcabf771740c550447b7d, regionState=CLOSED 2023-07-11 15:30:09,636 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089409636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089409636"}]},"ts":"1689089409636"} 2023-07-11 15:30:09,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:30:09,637 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0d7ffd07bde1fec31cb7e119c5f2997f, regionState=CLOSED 2023-07-11 15:30:09,637 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689089409637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089409637"}]},"ts":"1689089409637"} 2023-07-11 15:30:09,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-11 15:30:09,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 54197fa9522bcabf771740c550447b7d, server=jenkins-hbase9.apache.org,39487,1689089363864 in 175 msec 2023-07-11 15:30:09,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-11 15:30:09,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 0d7ffd07bde1fec31cb7e119c5f2997f, server=jenkins-hbase9.apache.org,42251,1689089363923 in 177 msec 2023-07-11 15:30:09,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=54197fa9522bcabf771740c550447b7d, UNASSIGN in 184 msec 2023-07-11 15:30:09,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-11 15:30:09,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d7ffd07bde1fec31cb7e119c5f2997f, UNASSIGN in 185 msec 2023-07-11 15:30:09,647 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089409646"}]},"ts":"1689089409646"} 2023-07-11 15:30:09,648 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 15:30:09,649 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-11 15:30:09,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 203 msec 2023-07-11 15:30:09,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 15:30:09,758 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-11 15:30:09,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-11 15:30:09,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,763 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-11 15:30:09,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,765 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-11 15:30:09,768 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,768 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,768 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,768 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 15:30:09,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 15:30:09,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 15:30:09,770 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:30:09,770 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:09,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:09,771 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:09,771 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:09,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 15:30:09,773 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/recovered.edits] 2023-07-11 15:30:09,773 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/recovered.edits] 2023-07-11 15:30:09,778 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf/9abac28e5226430bb4b19048e1c1bcde to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/cf/9abac28e5226430bb4b19048e1c1bcde 2023-07-11 15:30:09,778 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf/4e83cd7fc09f4c89a0e5603f69ee6032 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/cf/4e83cd7fc09f4c89a0e5603f69ee6032 2023-07-11 15:30:09,782 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f/recovered.edits/9.seqid 2023-07-11 15:30:09,783 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d/recovered.edits/9.seqid 2023-07-11 15:30:09,783 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/0d7ffd07bde1fec31cb7e119c5f2997f 2023-07-11 15:30:09,783 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemState/54197fa9522bcabf771740c550447b7d 2023-07-11 15:30:09,783 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 15:30:09,784 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-11 15:30:09,785 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-11 15:30:09,788 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230711b4edbaf2a8a547fb934f1b6671c7779c to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230711b4edbaf2a8a547fb934f1b6671c7779c 2023-07-11 15:30:09,790 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ccee46a4b85c47559f06a3e352f4c67f to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ccee46a4b85c47559f06a3e352f4c67f 2023-07-11 15:30:09,790 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-11 15:30:09,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,796 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-11 15:30:09,799 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-11 15:30:09,801 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,801 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-11 15:30:09,801 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089409801"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:09,801 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089409801"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:09,810 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 15:30:09,810 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0d7ffd07bde1fec31cb7e119c5f2997f, NAME => 'testtb-testExportFileSystemState,,1689089393829.0d7ffd07bde1fec31cb7e119c5f2997f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 54197fa9522bcabf771740c550447b7d, NAME => 'testtb-testExportFileSystemState,1,1689089393829.54197fa9522bcabf771740c550447b7d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 15:30:09,810 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-11 15:30:09,810 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089409810"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:09,813 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-11 15:30:09,815 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 15:30:09,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 56 msec 2023-07-11 15:30:09,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 15:30:09,874 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-11 15:30:09,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-11 15:30:09,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-11 15:30:09,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-11 15:30:09,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-11 15:30:09,913 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 752) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2024 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1863491776_1 at /127.0.0.1:58770 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:58794 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:40011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:52078 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:40088 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1863491776_1 at /127.0.0.1:52044 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:45419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=936 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=561 (was 531) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 178), AvailableMemoryMB=6592 (was 6754) 2023-07-11 15:30:09,913 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-11 15:30:09,933 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=561, ProcessCount=178, AvailableMemoryMB=6591 2023-07-11 15:30:09,933 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-11 15:30:09,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 15:30:09,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:09,939 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:30:09,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-11 15:30:09,940 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:30:09,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 15:30:09,942 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:09,942 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:09,943 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 empty. 2023-07-11 15:30:09,943 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a empty. 2023-07-11 15:30:09,943 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:09,943 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:09,943 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 15:30:09,954 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-11 15:30:09,956 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 38ed402de0f594486d4752df5f7e7384, NAME => 'testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:30:09,956 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ed3d8d7d29ee4e9160f98838032eb07a, NAME => 'testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:30:09,975 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:09,975 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 38ed402de0f594486d4752df5f7e7384, disabling compactions & flushes 2023-07-11 15:30:09,976 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. after waiting 0 ms 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:09,976 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 38ed402de0f594486d4752df5f7e7384: 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ed3d8d7d29ee4e9160f98838032eb07a, disabling compactions & flushes 2023-07-11 15:30:09,976 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. after waiting 0 ms 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:09,976 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:09,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ed3d8d7d29ee4e9160f98838032eb07a: 2023-07-11 15:30:09,978 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:30:09,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089409979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089409979"}]},"ts":"1689089409979"} 2023-07-11 15:30:09,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089409979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089409979"}]},"ts":"1689089409979"} 2023-07-11 15:30:09,982 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:30:09,983 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:30:09,983 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089409983"}]},"ts":"1689089409983"} 2023-07-11 15:30:09,984 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-11 15:30:09,987 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:30:09,989 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:30:09,989 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:30:09,989 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:30:09,989 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:30:09,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, ASSIGN}] 2023-07-11 15:30:09,991 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, ASSIGN 2023-07-11 15:30:09,992 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, ASSIGN 2023-07-11 15:30:09,992 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33731,1689089363968; forceNewPlan=false, retain=false 2023-07-11 15:30:09,992 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42251,1689089363923; forceNewPlan=false, retain=false 2023-07-11 15:30:10,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 15:30:10,143 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:30:10,145 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=38ed402de0f594486d4752df5f7e7384, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,145 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed3d8d7d29ee4e9160f98838032eb07a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,146 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089410145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089410145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089410145"}]},"ts":"1689089410145"} 2023-07-11 15:30:10,146 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089410145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089410145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089410145"}]},"ts":"1689089410145"} 2023-07-11 15:30:10,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 38ed402de0f594486d4752df5f7e7384, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:30:10,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ed3d8d7d29ee4e9160f98838032eb07a, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:30:10,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 15:30:10,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38ed402de0f594486d4752df5f7e7384, NAME => 'testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 15:30:10,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. service=AccessControlService 2023-07-11 15:30:10,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:10,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed3d8d7d29ee4e9160f98838032eb07a, NAME => 'testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. service=AccessControlService 2023-07-11 15:30:10,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,308 INFO [StoreOpener-38ed402de0f594486d4752df5f7e7384-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,309 INFO [StoreOpener-ed3d8d7d29ee4e9160f98838032eb07a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,309 DEBUG [StoreOpener-38ed402de0f594486d4752df5f7e7384-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf 2023-07-11 15:30:10,310 DEBUG [StoreOpener-38ed402de0f594486d4752df5f7e7384-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf 2023-07-11 15:30:10,310 DEBUG [StoreOpener-ed3d8d7d29ee4e9160f98838032eb07a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf 2023-07-11 15:30:10,310 DEBUG [StoreOpener-ed3d8d7d29ee4e9160f98838032eb07a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf 2023-07-11 15:30:10,310 INFO [StoreOpener-38ed402de0f594486d4752df5f7e7384-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38ed402de0f594486d4752df5f7e7384 columnFamilyName cf 2023-07-11 15:30:10,310 INFO [StoreOpener-ed3d8d7d29ee4e9160f98838032eb07a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed3d8d7d29ee4e9160f98838032eb07a columnFamilyName cf 2023-07-11 15:30:10,312 INFO [StoreOpener-38ed402de0f594486d4752df5f7e7384-1] regionserver.HStore(310): Store=38ed402de0f594486d4752df5f7e7384/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:10,312 INFO [StoreOpener-ed3d8d7d29ee4e9160f98838032eb07a-1] regionserver.HStore(310): Store=ed3d8d7d29ee4e9160f98838032eb07a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:10,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:10,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:10,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:30:10,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 38ed402de0f594486d4752df5f7e7384; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68255341, jitterRate=0.01708383858203888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:10,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 38ed402de0f594486d4752df5f7e7384: 2023-07-11 15:30:10,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:30:10,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ed3d8d7d29ee4e9160f98838032eb07a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70821830, jitterRate=0.05532750487327576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:10,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384., pid=45, masterSystemTime=1689089410300 2023-07-11 15:30:10,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ed3d8d7d29ee4e9160f98838032eb07a: 2023-07-11 15:30:10,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a., pid=46, masterSystemTime=1689089410301 2023-07-11 15:30:10,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=38ed402de0f594486d4752df5f7e7384, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:10,323 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089410323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089410323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089410323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089410323"}]},"ts":"1689089410323"} 2023-07-11 15:30:10,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:10,323 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed3d8d7d29ee4e9160f98838032eb07a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089410323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089410323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089410323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089410323"}]},"ts":"1689089410323"} 2023-07-11 15:30:10,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-11 15:30:10,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 38ed402de0f594486d4752df5f7e7384, server=jenkins-hbase9.apache.org,42251,1689089363923 in 177 msec 2023-07-11 15:30:10,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-11 15:30:10,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ed3d8d7d29ee4e9160f98838032eb07a, server=jenkins-hbase9.apache.org,33731,1689089363968 in 178 msec 2023-07-11 15:30:10,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, ASSIGN in 338 msec 2023-07-11 15:30:10,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-11 15:30:10,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, ASSIGN in 339 msec 2023-07-11 15:30:10,332 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:30:10,332 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089410332"}]},"ts":"1689089410332"} 2023-07-11 15:30:10,333 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-11 15:30:10,337 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:30:10,337 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-11 15:30:10,339 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 15:30:10,340 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:10,340 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:10,340 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:10,340 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:10,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:10,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:10,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:10,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:10,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 406 msec 2023-07-11 15:30:10,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 15:30:10,544 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-11 15:30:10,546 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 15:30:10,546 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,548 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:30:10,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 15:30:10,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089410559 (current time:1689089410559). 2023-07-11 15:30:10,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:30:10,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x1ca34538 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:10,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b806fa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:10,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:10,569 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:10,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ca34538 to 127.0.0.1:55301 2023-07-11 15:30:10,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:10,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x6829c995 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:10,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ea5db2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:10,576 DEBUG [hconnection-0x56606c09-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:10,579 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:10,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:10,583 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:10,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6829c995 to 127.0.0.1:55301 2023-07-11 15:30:10,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:10,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 15:30:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:30:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 15:30:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 15:30:10,588 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 15:30:10,589 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689090010589 2023-07-11 15:30:10,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 15:30:10,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 15:30:10,590 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:30:10,590 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:30:10,592 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 15:30:10,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 15:30:10,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-11 15:30:10,594 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 15:30:10,594 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689090010594 2023-07-11 15:30:10,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,610 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-11 15:30:10,610 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:10,611 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 15:30:10,611 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 15:30:10,612 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,612 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,613 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,613 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:10,613 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:10,613 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:10,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:10,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:10,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:10,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:10,613 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:10,613 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:10,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,614 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,614 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:30:10,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,615 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 15:30:10,615 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:10,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,616 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 15:30:10,616 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 15:30:10,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 15:30:10,619 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:10,622 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 15:30:10,622 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 15:30:10,623 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 15:30:10,625 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,625 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:10,625 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,625 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:10,625 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,626 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:10,626 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,626 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,627 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:10,627 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,627 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e9d2da4[Count = 1] remaining members to acquire global barrier 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:10,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:10,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:10,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 15:30:10,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e9d2da4[Count = 0] remaining members to acquire global barrier 2023-07-11 15:30:10,631 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 15:30:10,631 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 15:30:10,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,632 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,632 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 15:30:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,633 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:10,633 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. started... 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 15:30:10,633 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,633 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:10,633 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:30:10,633 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,634 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed3d8d7d29ee4e9160f98838032eb07a: 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. started... 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38ed402de0f594486d4752df5f7e7384: 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:10,635 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:30:10,641 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 15:30:10,641 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:10,641 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 15:30:10,665 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. completed. 2023-07-11 15:30:10,665 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,665 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:10,665 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:10,665 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,665 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 15:30:10,665 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:30:10,665 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. completed. 2023-07-11 15:30:10,666 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:10,666 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:10,666 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:10,666 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,666 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 15:30:10,666 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:30:10,667 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 15:30:10,667 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,667 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:10,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:10,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:10,667 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 15:30:10,669 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:10,669 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 15:30:10,669 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:10,669 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 15:30:10,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:10,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:30:10,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 15:30:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:10,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:10,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:30:10,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 15:30:10,677 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-11 15:30:10,677 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:30:10,677 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:30:10,677 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,677 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:10,679 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,679 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:10,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,680 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,681 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,682 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,683 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,683 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:10,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,687 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:10,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:10,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:10,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-11 15:30:10,687 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:10,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:10,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:10,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:10,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,689 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:10,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 15:30:10,690 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:10,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 15:30:10,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:10,692 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:30:10,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 15:30:10,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,740 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:10,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689089410589Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689089410697 (+108 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689089410697Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689089410697Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689089410701 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689089410713 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689089410740 (+27 ms) 2023-07-11 15:30:10,743 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 15:30:10,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 153 msec 2023-07-11 15:30:10,892 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:10,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 15:30:10,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:30:10,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42251] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:30:10,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33731] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:30:10,900 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 15:30:10,901 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:10,901 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:30:10,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 15:30:10,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089410911 (current time:1689089410911). 2023-07-11 15:30:10,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:30:10,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x6df713bd to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:10,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fc9469d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:10,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:10,926 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:10,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6df713bd to 127.0.0.1:55301 2023-07-11 15:30:10,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:10,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x7325deb7 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:10,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@269a4195, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:10,934 DEBUG [hconnection-0x63220675-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:10,936 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:10,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:10,943 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7325deb7 to 127.0.0.1:55301 2023-07-11 15:30:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 15:30:10,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:30:10,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 15:30:10,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 15:30:10,949 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 15:30:10,950 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689090010950 2023-07-11 15:30:10,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 15:30:10,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 15:30:10,952 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:30:10,952 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:30:10,955 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 15:30:10,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 15:30:10,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-11 15:30:10,958 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 15:30:10,959 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689090010959 2023-07-11 15:30:11,052 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:11,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 15:30:11,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:11,054 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:30:11,254 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:11,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 15:30:11,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:11,255 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:30:11,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-11 15:30:11,385 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-11 15:30:11,385 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:11,385 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 15:30:11,385 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 15:30:11,386 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,386 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,387 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:11,387 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:11,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:11,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:11,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:11,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:11,387 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,387 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:11,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:11,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:11,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,387 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,388 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,388 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,388 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 15:30:11,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 15:30:11,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 15:30:11,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 15:30:11,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 15:30:11,389 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 15:30:11,389 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:11,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 15:30:11,389 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 15:30:11,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 15:30:11,390 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 15:30:11,391 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 15:30:11,391 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 15:30:11,390 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:11,391 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 15:30:11,392 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 15:30:11,392 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 15:30:11,392 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 15:30:11,391 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:11,393 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 15:30:11,393 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 15:30:11,393 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 15:30:11,394 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,394 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:11,395 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,397 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,397 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:11,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:11,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2451b3d1[Count = 1] remaining members to acquire global barrier 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:11,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:11,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:11,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:11,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 15:30:11,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2451b3d1[Count = 0] remaining members to acquire global barrier 2023-07-11 15:30:11,401 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 15:30:11,401 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,402 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,403 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:11,403 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:30:11,403 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. started... 2023-07-11 15:30:11,403 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:11,403 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. started... 2023-07-11 15:30:11,403 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,404 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ed3d8d7d29ee4e9160f98838032eb07a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 15:30:11,404 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 38ed402de0f594486d4752df5f7e7384 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 15:30:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:11,404 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:30:11,405 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 15:30:11,405 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:11,405 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 15:30:11,431 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711ecd6c794c8e34122ba21017fae53edb9 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711ecd6c794c8e34122ba21017fae53edb9 2023-07-11 15:30:11,431 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711f90ad076d29642d6be3557f75473ff5c to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711f90ad076d29642d6be3557f75473ff5c 2023-07-11 15:30:11,443 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/.tmp/cf/20fc58faa07a4229a4f742700a7a896e 2023-07-11 15:30:11,443 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/.tmp/cf/712d9616242f4914bb1210e485da5333 2023-07-11 15:30:11,448 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/.tmp/cf/712d9616242f4914bb1210e485da5333 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf/712d9616242f4914bb1210e485da5333 2023-07-11 15:30:11,448 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/.tmp/cf/20fc58faa07a4229a4f742700a7a896e as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf/20fc58faa07a4229a4f742700a7a896e 2023-07-11 15:30:11,453 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf/712d9616242f4914bb1210e485da5333, entries=3, sequenceid=6, filesize=5.4 K 2023-07-11 15:30:11,453 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf/20fc58faa07a4229a4f742700a7a896e, entries=47, sequenceid=6, filesize=12.7 K 2023-07-11 15:30:11,454 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 38ed402de0f594486d4752df5f7e7384 in 50ms, sequenceid=6, compaction requested=false 2023-07-11 15:30:11,454 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ed3d8d7d29ee4e9160f98838032eb07a in 51ms, sequenceid=6, compaction requested=false 2023-07-11 15:30:11,454 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-11 15:30:11,454 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed3d8d7d29ee4e9160f98838032eb07a: 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 38ed402de0f594486d4752df5f7e7384: 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf/20fc58faa07a4229a4f742700a7a896e] hfiles 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf/20fc58faa07a4229a4f742700a7a896e for snapshot=snaptb0-testConsecutiveExports 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf/712d9616242f4914bb1210e485da5333] hfiles 2023-07-11 15:30:11,456 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf/712d9616242f4914bb1210e485da5333 for snapshot=snaptb0-testConsecutiveExports 2023-07-11 15:30:11,466 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. completed. 2023-07-11 15:30:11,466 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. completed. 2023-07-11 15:30:11,466 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:11,466 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 15:30:11,467 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:30:11,468 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,469 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 15:30:11,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:11,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:11,469 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:11,469 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 15:30:11,470 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 15:30:11,470 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,470 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:11,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:11,470 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 15:30:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:11,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:30:11,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:30:11,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 15:30:11,478 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-11 15:30:11,478 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:30:11,478 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:30:11,478 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-11 15:30:11,478 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:11,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:11,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:11,480 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:11,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,481 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:11,481 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:11,483 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 15:30:11,484 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,484 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:11,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:11,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-11 15:30:11,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:11,490 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:11,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:11,489 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:11,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:11,489 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:11,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:11,490 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 15:30:11,491 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:11,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:11,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:11,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:11,491 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:11,491 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:11,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:11,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:30:11,492 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:11,492 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:11,492 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,492 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711f90ad076d29642d6be3557f75473ff5c, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711ecd6c794c8e34122ba21017fae53edb9] mob files 2023-07-11 15:30:11,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711f90ad076d29642d6be3557f75473ff5c 2023-07-11 15:30:11,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711ecd6c794c8e34122ba21017fae53edb9 2023-07-11 15:30:11,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-11 15:30:11,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,555 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:11,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 15:30:11,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:11,557 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 15:30:11,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 15:30:11,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,558 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:11,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689089410950Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689089411502 (+552 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689089411502Loading Region manifests for snaptb0-testConsecutiveExports at 1689089411502Writing data manifest for snaptb0-testConsecutiveExports at 1689089411507 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689089411518 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689089411557 (+39 ms) 2023-07-11 15:30:11,561 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 15:30:11,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 610 msec 2023-07-11 15:30:12,057 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:12,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 15:30:12,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:30:12,059 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059 2023-07-11 15:30:12,059 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:30:12,082 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:30:12,082 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@14f3459, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:12,082 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 15:30:12,093 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:12,111 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,112 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,113 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,113 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,114 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,114 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,115 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,187 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-5991923566210103286.jar 2023-07-11 15:30:12,188 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,188 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,189 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,189 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,189 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,190 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:12,190 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:30:12,190 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:30:12,191 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:30:12,191 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:30:12,191 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:30:12,192 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:30:12,192 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:30:12,193 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:30:12,193 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:30:12,193 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:30:12,194 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:12,194 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:12,195 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:12,195 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:12,195 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:12,195 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:12,196 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:13,070 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:30:13,073 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 15:30:13,075 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-11 15:30:14,392 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:30:14,392 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:30:14,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0002_000001 (auth:SIMPLE) 2023-07-11 15:30:15,091 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0003_000001 (auth:SIMPLE) 2023-07-11 15:30:15,213 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:30:19,508 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0003_000001 (auth:SIMPLE) 2023-07-11 15:30:21,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0003_000001 (auth:SIMPLE) 2023-07-11 15:30:26,268 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:30:26,268 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:30:26,274 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 15:30:26,274 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:30:26,274 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:30:26,275 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 15:30:26,277 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 15:30:26,277 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 15:30:26,277 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2be45767 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 15:30:26,277 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 15:30:26,277 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 15:30:26,279 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:30:26,301 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:30:26,301 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@d515020, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:26,302 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 15:30:26,310 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 15:30:26,321 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,322 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,322 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,322 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,323 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,323 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,323 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,391 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-6473221184369225189.jar 2023-07-11 15:30:26,391 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,392 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,392 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,392 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,393 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,393 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:26,393 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:30:26,394 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:30:26,394 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:30:26,395 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:30:26,395 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:30:26,395 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:30:26,396 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:30:26,396 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:30:26,396 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:30:26,397 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:30:26,397 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:26,397 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:26,398 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:26,398 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:26,398 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:26,399 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:26,399 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:26,801 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:30:26,803 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 15:30:26,805 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-11 15:30:30,890 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:30:30,890 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:30:30,892 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0003_000001 (auth:SIMPLE) 2023-07-11 15:30:31,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0004_000001 (auth:SIMPLE) 2023-07-11 15:30:35,695 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0004_000001 (auth:SIMPLE) 2023-07-11 15:30:37,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0004_000001 (auth:SIMPLE) 2023-07-11 15:30:41,489 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0004_000001 (auth:SIMPLE) 2023-07-11 15:30:43,059 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:30:43,059 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:30:43,065 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 15:30:43,065 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:30:43,065 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:30:43,066 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 15:30:43,072 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 15:30:43,072 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 15:30:43,072 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2be45767 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 15:30:43,072 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 15:30:43,072 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/local-export-1689089412059/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 15:30:43,090 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-11 15:30:43,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-11 15:30:43,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 15:30:43,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089443098"}]},"ts":"1689089443098"} 2023-07-11 15:30:43,100 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-11 15:30:43,106 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-11 15:30:43,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, UNASSIGN}] 2023-07-11 15:30:43,111 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, UNASSIGN 2023-07-11 15:30:43,111 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, UNASSIGN 2023-07-11 15:30:43,112 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=38ed402de0f594486d4752df5f7e7384, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:43,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed3d8d7d29ee4e9160f98838032eb07a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:43,112 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089443112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089443112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089443112"}]},"ts":"1689089443112"} 2023-07-11 15:30:43,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089443112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089443112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089443112"}]},"ts":"1689089443112"} 2023-07-11 15:30:43,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 38ed402de0f594486d4752df5f7e7384, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:30:43,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ed3d8d7d29ee4e9160f98838032eb07a, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:30:43,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 15:30:43,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:43,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 38ed402de0f594486d4752df5f7e7384, disabling compactions & flushes 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ed3d8d7d29ee4e9160f98838032eb07a, disabling compactions & flushes 2023-07-11 15:30:43,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:43,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. after waiting 0 ms 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. after waiting 0 ms 2023-07-11 15:30:43,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:43,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:30:43,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:30:43,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:30:43,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:30:43,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a. 2023-07-11 15:30:43,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ed3d8d7d29ee4e9160f98838032eb07a: 2023-07-11 15:30:43,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384. 2023-07-11 15:30:43,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 38ed402de0f594486d4752df5f7e7384: 2023-07-11 15:30:43,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:43,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=38ed402de0f594486d4752df5f7e7384, regionState=CLOSED 2023-07-11 15:30:43,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089443296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089443296"}]},"ts":"1689089443296"} 2023-07-11 15:30:43,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:43,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed3d8d7d29ee4e9160f98838032eb07a, regionState=CLOSED 2023-07-11 15:30:43,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689089443297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089443297"}]},"ts":"1689089443297"} 2023-07-11 15:30:43,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-11 15:30:43,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 38ed402de0f594486d4752df5f7e7384, server=jenkins-hbase9.apache.org,42251,1689089363923 in 184 msec 2023-07-11 15:30:43,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-11 15:30:43,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=38ed402de0f594486d4752df5f7e7384, UNASSIGN in 192 msec 2023-07-11 15:30:43,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ed3d8d7d29ee4e9160f98838032eb07a, server=jenkins-hbase9.apache.org,33731,1689089363968 in 184 msec 2023-07-11 15:30:43,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-11 15:30:43,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed3d8d7d29ee4e9160f98838032eb07a, UNASSIGN in 194 msec 2023-07-11 15:30:43,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089443311"}]},"ts":"1689089443311"} 2023-07-11 15:30:43,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-11 15:30:43,315 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-11 15:30:43,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 224 msec 2023-07-11 15:30:43,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 15:30:43,400 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-11 15:30:43,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-11 15:30:43,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,405 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-11 15:30:43,407 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,410 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-11 15:30:43,413 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,413 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,414 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,414 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 15:30:43,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 15:30:43,414 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:43,415 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:43,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 15:30:43,415 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 15:30:43,416 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:43,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 15:30:43,418 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/recovered.edits] 2023-07-11 15:30:43,418 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/recovered.edits] 2023-07-11 15:30:43,424 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf/712d9616242f4914bb1210e485da5333 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/cf/712d9616242f4914bb1210e485da5333 2023-07-11 15:30:43,430 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf/20fc58faa07a4229a4f742700a7a896e to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/cf/20fc58faa07a4229a4f742700a7a896e 2023-07-11 15:30:43,431 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384/recovered.edits/9.seqid 2023-07-11 15:30:43,432 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/38ed402de0f594486d4752df5f7e7384 2023-07-11 15:30:43,434 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a/recovered.edits/9.seqid 2023-07-11 15:30:43,434 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testConsecutiveExports/ed3d8d7d29ee4e9160f98838032eb07a 2023-07-11 15:30:43,435 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 15:30:43,435 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-11 15:30:43,436 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-11 15:30:43,440 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711f90ad076d29642d6be3557f75473ff5c to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230711f90ad076d29642d6be3557f75473ff5c 2023-07-11 15:30:43,442 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711ecd6c794c8e34122ba21017fae53edb9 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230711ecd6c794c8e34122ba21017fae53edb9 2023-07-11 15:30:43,442 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-11 15:30:43,445 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,448 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-11 15:30:43,451 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-11 15:30:43,452 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,452 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-11 15:30:43,452 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089443452"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:43,452 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089443452"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:43,454 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 15:30:43,454 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 38ed402de0f594486d4752df5f7e7384, NAME => 'testtb-testConsecutiveExports,,1689089409935.38ed402de0f594486d4752df5f7e7384.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ed3d8d7d29ee4e9160f98838032eb07a, NAME => 'testtb-testConsecutiveExports,1,1689089409935.ed3d8d7d29ee4e9160f98838032eb07a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 15:30:43,454 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-11 15:30:43,455 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089443454"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:43,456 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-11 15:30:43,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 15:30:43,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 59 msec 2023-07-11 15:30:43,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 15:30:43,519 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-11 15:30:43,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-11 15:30:43,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-11 15:30:43,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-11 15:30:43,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-11 15:30:43,591 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 764), OpenFileDescriptor=910 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=619 (was 561) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6725 (was 6591) - AvailableMemoryMB LEAK? - 2023-07-11 15:30:43,591 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-11 15:30:43,626 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=619, ProcessCount=180, AvailableMemoryMB=6721 2023-07-11 15:30:43,626 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-11 15:30:43,628 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 15:30:43,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:43,647 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:30:43,647 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-11 15:30:43,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 15:30:43,648 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:30:43,653 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:43,653 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e 2023-07-11 15:30:43,654 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 empty. 2023-07-11 15:30:43,654 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e empty. 2023-07-11 15:30:43,655 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:43,655 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e 2023-07-11 15:30:43,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 15:30:43,694 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-11 15:30:43,698 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8ddfe2fd58a8315d64ba95ae6272b489, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:30:43,698 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 358adb390912fd1598b90adf545a881e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:30:43,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:43,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 358adb390912fd1598b90adf545a881e, disabling compactions & flushes 2023-07-11 15:30:43,735 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:43,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:43,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. after waiting 0 ms 2023-07-11 15:30:43,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:43,735 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:43,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 358adb390912fd1598b90adf545a881e: 2023-07-11 15:30:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 15:30:43,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 15:30:44,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:44,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 8ddfe2fd58a8315d64ba95ae6272b489, disabling compactions & flushes 2023-07-11 15:30:44,142 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. after waiting 0 ms 2023-07-11 15:30:44,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,142 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 8ddfe2fd58a8315d64ba95ae6272b489: 2023-07-11 15:30:44,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:30:44,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089444148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089444148"}]},"ts":"1689089444148"} 2023-07-11 15:30:44,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089444148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089444148"}]},"ts":"1689089444148"} 2023-07-11 15:30:44,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:30:44,163 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:30:44,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089444163"}]},"ts":"1689089444163"} 2023-07-11 15:30:44,164 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-11 15:30:44,169 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:30:44,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:30:44,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:30:44,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:30:44,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:30:44,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, ASSIGN}] 2023-07-11 15:30:44,173 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, ASSIGN 2023-07-11 15:30:44,173 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, ASSIGN 2023-07-11 15:30:44,180 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39487,1689089363864; forceNewPlan=false, retain=false 2023-07-11 15:30:44,180 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33731,1689089363968; forceNewPlan=false, retain=false 2023-07-11 15:30:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 15:30:44,330 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:30:44,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8ddfe2fd58a8315d64ba95ae6272b489, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:44,334 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=358adb390912fd1598b90adf545a881e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:44,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089444334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089444334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089444334"}]},"ts":"1689089444334"} 2023-07-11 15:30:44,334 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089444334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089444334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089444334"}]},"ts":"1689089444334"} 2023-07-11 15:30:44,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 8ddfe2fd58a8315d64ba95ae6272b489, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:30:44,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 358adb390912fd1598b90adf545a881e, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:30:44,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:44,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 358adb390912fd1598b90adf545a881e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 15:30:44,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. service=AccessControlService 2023-07-11 15:30:44,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:44,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ddfe2fd58a8315d64ba95ae6272b489, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. service=AccessControlService 2023-07-11 15:30:44,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,500 INFO [StoreOpener-8ddfe2fd58a8315d64ba95ae6272b489-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,502 INFO [StoreOpener-358adb390912fd1598b90adf545a881e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,503 DEBUG [StoreOpener-8ddfe2fd58a8315d64ba95ae6272b489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf 2023-07-11 15:30:44,503 DEBUG [StoreOpener-8ddfe2fd58a8315d64ba95ae6272b489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf 2023-07-11 15:30:44,504 INFO [StoreOpener-8ddfe2fd58a8315d64ba95ae6272b489-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ddfe2fd58a8315d64ba95ae6272b489 columnFamilyName cf 2023-07-11 15:30:44,504 DEBUG [StoreOpener-358adb390912fd1598b90adf545a881e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf 2023-07-11 15:30:44,504 DEBUG [StoreOpener-358adb390912fd1598b90adf545a881e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf 2023-07-11 15:30:44,505 INFO [StoreOpener-358adb390912fd1598b90adf545a881e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 358adb390912fd1598b90adf545a881e columnFamilyName cf 2023-07-11 15:30:44,506 INFO [StoreOpener-358adb390912fd1598b90adf545a881e-1] regionserver.HStore(310): Store=358adb390912fd1598b90adf545a881e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:44,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 358adb390912fd1598b90adf545a881e 2023-07-11 15:30:44,514 INFO [StoreOpener-8ddfe2fd58a8315d64ba95ae6272b489-1] regionserver.HStore(310): Store=8ddfe2fd58a8315d64ba95ae6272b489/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:44,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:30:44,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 358adb390912fd1598b90adf545a881e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63759356, jitterRate=-0.049911558628082275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:44,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 358adb390912fd1598b90adf545a881e: 2023-07-11 15:30:44,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e., pid=61, masterSystemTime=1689089444490 2023-07-11 15:30:44,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:44,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:44,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=358adb390912fd1598b90adf545a881e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:44,537 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089444536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089444536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089444536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089444536"}]},"ts":"1689089444536"} 2023-07-11 15:30:44,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:30:44,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:30:44,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8ddfe2fd58a8315d64ba95ae6272b489; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71633395, jitterRate=0.06742076575756073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:44,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8ddfe2fd58a8315d64ba95ae6272b489: 2023-07-11 15:30:44,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489., pid=60, masterSystemTime=1689089444489 2023-07-11 15:30:44,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,548 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8ddfe2fd58a8315d64ba95ae6272b489, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:44,548 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089444548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089444548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089444548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089444548"}]},"ts":"1689089444548"} 2023-07-11 15:30:44,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-11 15:30:44,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 358adb390912fd1598b90adf545a881e, server=jenkins-hbase9.apache.org,33731,1689089363968 in 201 msec 2023-07-11 15:30:44,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-11 15:30:44,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 8ddfe2fd58a8315d64ba95ae6272b489, server=jenkins-hbase9.apache.org,39487,1689089363864 in 213 msec 2023-07-11 15:30:44,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, ASSIGN in 392 msec 2023-07-11 15:30:44,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-11 15:30:44,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, ASSIGN in 392 msec 2023-07-11 15:30:44,578 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:30:44,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089444578"}]},"ts":"1689089444578"} 2023-07-11 15:30:44,580 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-11 15:30:44,583 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:30:44,583 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-11 15:30:44,586 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 15:30:44,587 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:44,587 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:44,587 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:44,587 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:44,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:44,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:44,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:44,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:44,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 961 msec 2023-07-11 15:30:44,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 15:30:44,754 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-11 15:30:44,760 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:44,760 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:44,765 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:30:44,790 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 15:30:44,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089444790 (current time:1689089444790). 2023-07-11 15:30:44,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:30:44,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x23d7205c to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:44,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f034299, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:44,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:44,816 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23d7205c to 127.0.0.1:55301 2023-07-11 15:30:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x2ea89325 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:44,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34e7836c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:44,934 DEBUG [hconnection-0x519508e3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:44,935 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:44,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:44,946 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:44,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ea89325 to 127.0.0.1:55301 2023-07-11 15:30:44,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 15:30:44,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:30:44,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 15:30:44,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 15:30:44,959 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 15:30:44,960 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689090044960 2023-07-11 15:30:44,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 15:30:44,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:44,962 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:30:44,962 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:30:44,963 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 15:30:44,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 15:30:44,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-11 15:30:44,966 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 15:30:44,966 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689090044966 2023-07-11 15:30:45,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,061 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 15:30:45,061 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,063 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:45,063 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 15:30:45,063 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 15:30:45,064 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,064 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 15:30:45,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:45,064 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:30:45,065 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,065 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,065 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,065 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,066 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,066 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,067 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 15:30:45,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,068 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 15:30:45,068 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,070 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 15:30:45,070 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,070 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 15:30:45,071 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 15:30:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 15:30:45,071 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 15:30:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,071 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 15:30:45,072 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 15:30:45,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 15:30:45,072 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 15:30:45,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,072 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 15:30:45,072 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,073 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 15:30:45,073 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 15:30:45,073 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 15:30:45,074 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,076 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,076 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,076 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,077 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,077 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,077 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:45,077 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,077 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 15:30:45,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2407351d[Count = 1] remaining members to acquire global barrier 2023-07-11 15:30:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,083 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,083 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:45,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 15:30:45,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2407351d[Count = 0] remaining members to acquire global barrier 2023-07-11 15:30:45,085 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 15:30:45,085 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,086 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 15:30:45,087 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 15:30:45,087 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:30:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,087 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 15:30:45,088 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,087 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 15:30:45,090 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:45,090 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:45,090 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:45,090 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. started... 2023-07-11 15:30:45,090 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ddfe2fd58a8315d64ba95ae6272b489: 2023-07-11 15:30:45,090 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,090 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:45,090 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:30:45,093 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 15:30:45,093 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,093 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 15:30:45,093 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,093 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:30:45,096 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:45,096 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:45,096 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:45,096 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. started... 2023-07-11 15:30:45,097 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 358adb390912fd1598b90adf545a881e: 2023-07-11 15:30:45,098 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,098 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:45,098 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:30:45,172 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. completed. 2023-07-11 15:30:45,172 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:45,172 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:45,172 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:45,172 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,173 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 15:30:45,173 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:30:45,175 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 15:30:45,175 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,175 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,179 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. completed. 2023-07-11 15:30:45,179 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:45,179 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:45,179 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:45,179 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,175 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 15:30:45,179 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 15:30:45,180 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:30:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,182 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 15:30:45,182 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,182 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 15:30:45,182 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:30:45,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 15:30:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:30:45,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 15:30:45,194 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 15:30:45,194 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:30:45,194 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:30:45,194 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,194 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:30:45,196 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,196 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,196 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,196 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,197 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,198 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,199 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,200 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,203 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,203 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,204 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,222 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,224 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,224 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,224 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,224 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,225 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,225 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:30:45,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 15:30:45,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,265 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 15:30:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:45,271 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:30:45,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 15:30:45,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,523 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689089444960Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689089445295 (+335 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689089445295Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689089445295Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689089445322 (+27 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689089445397 (+75 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689089445522 (+125 ms) 2023-07-11 15:30:45,526 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 15:30:45,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 564 msec 2023-07-11 15:30:45,571 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:45,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 15:30:45,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:30:45,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39487] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:30:45,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33731] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:30:45,583 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,583 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:45,583 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:30:45,600 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 15:30:45,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089445600 (current time:1689089445600). 2023-07-11 15:30:45,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:30:45,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x5b39055e to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71731def, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:45,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:45,618 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b39055e to 127.0.0.1:55301 2023-07-11 15:30:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:45,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x5979be28 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:45,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4af953ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:45,727 DEBUG [hconnection-0x238cb379-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:45,732 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:45,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:45,738 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:45,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5979be28 to 127.0.0.1:55301 2023-07-11 15:30:45,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:45,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 15:30:45,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:30:45,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 15:30:45,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 15:30:45,744 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 15:30:45,745 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689090045745 2023-07-11 15:30:45,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 15:30:45,747 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:30:45,747 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:30:45,748 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 15:30:45,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 15:30:45,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-11 15:30:45,750 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 15:30:45,751 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689090045751 2023-07-11 15:30:45,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,771 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 15:30:45,771 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,772 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 15:30:45,772 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 15:30:45,772 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,773 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,774 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,774 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,774 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:45,774 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,779 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,779 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 15:30:45,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,779 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 15:30:45,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,782 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 15:30:45,782 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 15:30:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 15:30:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,788 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,788 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 15:30:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,790 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,790 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:45,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,792 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,792 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 15:30:45,792 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,793 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 15:30:45,794 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 15:30:45,794 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 15:30:45,794 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 15:30:45,794 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:45,795 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 15:30:45,795 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 15:30:45,795 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 15:30:45,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,796 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,796 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,798 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,798 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,798 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:45,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,798 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,798 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:45,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 15:30:45,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d828ce[Count = 1] remaining members to acquire global barrier 2023-07-11 15:30:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 15:30:45,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d828ce[Count = 0] remaining members to acquire global barrier 2023-07-11 15:30:45,804 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 15:30:45,804 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,805 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,805 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,805 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 15:30:45,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 15:30:45,806 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 15:30:45,806 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:30:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,806 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 15:30:45,806 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,806 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:30:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 15:30:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,808 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:45,810 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:45,810 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:45,810 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. started... 2023-07-11 15:30:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 15:30:45,810 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. started... 2023-07-11 15:30:45,810 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ddfe2fd58a8315d64ba95ae6272b489 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 15:30:45,811 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 358adb390912fd1598b90adf545a881e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 15:30:45,847 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:45,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 15:30:45,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:45,850 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:30:45,865 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711b41a7ed4687a4dcaa438060620e36579 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230711b41a7ed4687a4dcaa438060620e36579 2023-07-11 15:30:45,866 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307112fe8b2049a654bc69d5e25defa4b0078 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307112fe8b2049a654bc69d5e25defa4b0078 2023-07-11 15:30:45,884 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/.tmp/cf/2d613f3c061c42608f7a704250640bbd 2023-07-11 15:30:45,890 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/.tmp/cf/88c940ac480340f1aa8486af73ac27f5 2023-07-11 15:30:45,895 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/.tmp/cf/2d613f3c061c42608f7a704250640bbd as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf/2d613f3c061c42608f7a704250640bbd 2023-07-11 15:30:45,898 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/.tmp/cf/88c940ac480340f1aa8486af73ac27f5 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf/88c940ac480340f1aa8486af73ac27f5 2023-07-11 15:30:45,903 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf/2d613f3c061c42608f7a704250640bbd, entries=47, sequenceid=6, filesize=13.5 K 2023-07-11 15:30:45,904 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 358adb390912fd1598b90adf545a881e in 93ms, sequenceid=6, compaction requested=false 2023-07-11 15:30:45,905 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-11 15:30:45,909 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 358adb390912fd1598b90adf545a881e: 2023-07-11 15:30:45,910 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,910 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:45,910 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf/2d613f3c061c42608f7a704250640bbd] hfiles 2023-07-11 15:30:45,910 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf/2d613f3c061c42608f7a704250640bbd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,913 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf/88c940ac480340f1aa8486af73ac27f5, entries=3, sequenceid=6, filesize=5.4 K 2023-07-11 15:30:45,917 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8ddfe2fd58a8315d64ba95ae6272b489 in 107ms, sequenceid=6, compaction requested=false 2023-07-11 15:30:45,920 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ddfe2fd58a8315d64ba95ae6272b489: 2023-07-11 15:30:45,920 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,920 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:45,920 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf/88c940ac480340f1aa8486af73ac27f5] hfiles 2023-07-11 15:30:45,920 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf/88c940ac480340f1aa8486af73ac27f5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,934 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. completed. 2023-07-11 15:30:45,934 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:30:45,934 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:45,934 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:45,934 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,934 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 15:30:45,934 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:30:45,936 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 15:30:45,936 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,936 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,936 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 15:30:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:30:45,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 15:30:45,970 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. completed. 2023-07-11 15:30:45,970 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:30:45,970 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:45,970 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:45,970 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,970 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 15:30:45,970 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:30:45,972 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,972 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 15:30:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,972 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:45,972 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 15:30:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:30:45,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 15:30:45,979 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 15:30:45,979 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:30:45,979 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:30:45,979 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,979 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:30:45,988 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:45,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,988 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:45,988 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,989 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,989 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:45,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,990 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,990 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,995 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:45,995 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:45,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:45,997 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:46,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:46,009 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:46,009 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:46,009 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:46,008 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:46,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,009 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:46,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:46,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:46,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:46,011 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,009 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:46,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:46,011 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:46,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:46,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:46,012 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:46,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:46,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:30:46,012 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:46,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:46,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:46,012 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307112fe8b2049a654bc69d5e25defa4b0078, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230711b41a7ed4687a4dcaa438060620e36579] mob files 2023-07-11 15:30:46,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307112fe8b2049a654bc69d5e25defa4b0078 2023-07-11 15:30:46,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230711b41a7ed4687a4dcaa438060620e36579 2023-07-11 15:30:46,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,050 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:46,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 15:30:46,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:46,059 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:30:46,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 15:30:46,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,128 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:30:46,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689089445745Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689089446032 (+287 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689089446032Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689089446033 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689089446055 (+22 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689089446077 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689089446127 (+50 ms) 2023-07-11 15:30:46,131 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 15:30:46,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 384 msec 2023-07-11 15:30:46,360 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:46,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 15:30:46,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:30:46,395 DEBUG [Listener at jenkins-hbase9.apache.org/40569] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 15:30:46,401 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 15:30:46,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33731] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 15:30:46,403 DEBUG [Listener at jenkins-hbase9.apache.org/40569] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 15:30:46,405 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 15:30:46,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39487] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 15:30:46,406 DEBUG [Listener at jenkins-hbase9.apache.org/40569] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 15:30:46,413 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 15:30:46,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42251] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 15:30:46,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 15:30:46,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:46,418 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:30:46,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-11 15:30:46,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:30:46,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 15:30:46,421 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:46,421 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:46,422 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf empty. 2023-07-11 15:30:46,422 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:46,422 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf empty. 2023-07-11 15:30:46,422 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:46,423 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 15:30:46,499 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-11 15:30:46,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a728fa814ccc91a1e0073466df9cadbf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:30:46,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 203f77b62d93e722f30bf36082b05ebf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:30:46,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 15:30:46,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:46,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 203f77b62d93e722f30bf36082b05ebf, disabling compactions & flushes 2023-07-11 15:30:46,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:46,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:46,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. after waiting 0 ms 2023-07-11 15:30:46,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:46,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:46,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 203f77b62d93e722f30bf36082b05ebf: 2023-07-11 15:30:46,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 15:30:46,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:46,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a728fa814ccc91a1e0073466df9cadbf, disabling compactions & flushes 2023-07-11 15:30:46,931 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:46,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:46,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. after waiting 0 ms 2023-07-11 15:30:46,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:46,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:46,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a728fa814ccc91a1e0073466df9cadbf: 2023-07-11 15:30:46,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:30:46,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089446935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089446935"}]},"ts":"1689089446935"} 2023-07-11 15:30:46,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089446935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089446935"}]},"ts":"1689089446935"} 2023-07-11 15:30:46,938 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:30:46,938 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:30:46,939 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089446939"}]},"ts":"1689089446939"} 2023-07-11 15:30:46,940 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-11 15:30:47,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 15:30:47,045 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:30:47,047 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:30:47,047 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:30:47,047 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:30:47,047 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:30:47,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, ASSIGN}] 2023-07-11 15:30:47,063 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, ASSIGN 2023-07-11 15:30:47,064 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, ASSIGN 2023-07-11 15:30:47,080 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33731,1689089363968; forceNewPlan=false, retain=false 2023-07-11 15:30:47,080 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39487,1689089363864; forceNewPlan=false, retain=false 2023-07-11 15:30:47,231 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:30:47,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a728fa814ccc91a1e0073466df9cadbf, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:47,233 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=203f77b62d93e722f30bf36082b05ebf, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:47,234 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089447233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089447233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089447233"}]},"ts":"1689089447233"} 2023-07-11 15:30:47,234 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089447233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089447233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089447233"}]},"ts":"1689089447233"} 2023-07-11 15:30:47,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure a728fa814ccc91a1e0073466df9cadbf, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:30:47,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 203f77b62d93e722f30bf36082b05ebf, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:30:47,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:47,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:47,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 203f77b62d93e722f30bf36082b05ebf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 15:30:47,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a728fa814ccc91a1e0073466df9cadbf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.', STARTKEY => '', ENDKEY => '2'} 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. service=AccessControlService 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. service=AccessControlService 2023-07-11 15:30:47,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:47,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,443 INFO [StoreOpener-a728fa814ccc91a1e0073466df9cadbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,443 INFO [StoreOpener-203f77b62d93e722f30bf36082b05ebf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,450 DEBUG [StoreOpener-a728fa814ccc91a1e0073466df9cadbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf 2023-07-11 15:30:47,450 DEBUG [StoreOpener-a728fa814ccc91a1e0073466df9cadbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf 2023-07-11 15:30:47,450 DEBUG [StoreOpener-203f77b62d93e722f30bf36082b05ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf 2023-07-11 15:30:47,450 DEBUG [StoreOpener-203f77b62d93e722f30bf36082b05ebf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf 2023-07-11 15:30:47,450 INFO [StoreOpener-a728fa814ccc91a1e0073466df9cadbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a728fa814ccc91a1e0073466df9cadbf columnFamilyName cf 2023-07-11 15:30:47,450 INFO [StoreOpener-203f77b62d93e722f30bf36082b05ebf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 203f77b62d93e722f30bf36082b05ebf columnFamilyName cf 2023-07-11 15:30:47,451 INFO [StoreOpener-203f77b62d93e722f30bf36082b05ebf-1] regionserver.HStore(310): Store=203f77b62d93e722f30bf36082b05ebf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:47,451 INFO [StoreOpener-a728fa814ccc91a1e0073466df9cadbf-1] regionserver.HStore(310): Store=a728fa814ccc91a1e0073466df9cadbf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:47,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:47,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:30:47,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:30:47,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a728fa814ccc91a1e0073466df9cadbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64907350, jitterRate=-0.03280511498451233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:47,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a728fa814ccc91a1e0073466df9cadbf: 2023-07-11 15:30:47,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 203f77b62d93e722f30bf36082b05ebf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65530611, jitterRate=-0.023517802357673645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:47,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 203f77b62d93e722f30bf36082b05ebf: 2023-07-11 15:30:47,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf., pid=70, masterSystemTime=1689089447438 2023-07-11 15:30:47,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf., pid=69, masterSystemTime=1689089447438 2023-07-11 15:30:47,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:47,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:47,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=203f77b62d93e722f30bf36082b05ebf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:47,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:47,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:47,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089447501"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089447501"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089447501"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089447501"}]},"ts":"1689089447501"} 2023-07-11 15:30:47,503 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a728fa814ccc91a1e0073466df9cadbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:47,503 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089447503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089447503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089447503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089447503"}]},"ts":"1689089447503"} 2023-07-11 15:30:47,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-11 15:30:47,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 203f77b62d93e722f30bf36082b05ebf, server=jenkins-hbase9.apache.org,33731,1689089363968 in 217 msec 2023-07-11 15:30:47,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-11 15:30:47,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure a728fa814ccc91a1e0073466df9cadbf, server=jenkins-hbase9.apache.org,39487,1689089363864 in 219 msec 2023-07-11 15:30:47,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, ASSIGN in 462 msec 2023-07-11 15:30:47,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-11 15:30:47,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, ASSIGN in 464 msec 2023-07-11 15:30:47,515 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:30:47,515 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089447515"}]},"ts":"1689089447515"} 2023-07-11 15:30:47,517 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-11 15:30:47,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 15:30:47,569 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:30:47,570 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-11 15:30:47,572 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 15:30:47,622 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:47,622 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:47,622 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:47,622 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:30:47,651 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0004_000001 (auth:SIMPLE) 2023-07-11 15:30:47,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 15:30:47,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 1.2410 sec 2023-07-11 15:30:48,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 15:30:48,529 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-11 15:30:48,564 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions a728fa814ccc91a1e0073466df9cadbf, 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:48,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a728fa814ccc91a1e0073466df9cadbf, 203f77b62d93e722f30bf36082b05ebf], force=true 2023-07-11 15:30:48,575 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a728fa814ccc91a1e0073466df9cadbf, 203f77b62d93e722f30bf36082b05ebf], force=true 2023-07-11 15:30:48,575 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a728fa814ccc91a1e0073466df9cadbf, 203f77b62d93e722f30bf36082b05ebf], force=true 2023-07-11 15:30:48,575 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a728fa814ccc91a1e0073466df9cadbf, 203f77b62d93e722f30bf36082b05ebf], force=true 2023-07-11 15:30:48,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 15:30:48,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, UNASSIGN}] 2023-07-11 15:30:48,606 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, UNASSIGN 2023-07-11 15:30:48,606 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, UNASSIGN 2023-07-11 15:30:48,607 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=203f77b62d93e722f30bf36082b05ebf, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:48,607 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a728fa814ccc91a1e0073466df9cadbf, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:48,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089448607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089448607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089448607"}]},"ts":"1689089448607"} 2023-07-11 15:30:48,607 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089448607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089448607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089448607"}]},"ts":"1689089448607"} 2023-07-11 15:30:48,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 203f77b62d93e722f30bf36082b05ebf, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:30:48,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a728fa814ccc91a1e0073466df9cadbf, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:30:48,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 15:30:48,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:48,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:48,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a728fa814ccc91a1e0073466df9cadbf, disabling compactions & flushes 2023-07-11 15:30:48,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:48,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 203f77b62d93e722f30bf36082b05ebf, disabling compactions & flushes 2023-07-11 15:30:48,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:48,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:48,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. after waiting 0 ms 2023-07-11 15:30:48,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:48,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:48,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. after waiting 0 ms 2023-07-11 15:30:48,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:48,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing a728fa814ccc91a1e0073466df9cadbf 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 15:30:48,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 203f77b62d93e722f30bf36082b05ebf 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 15:30:48,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/.tmp/cf/21994aac84634d3498076e6090a54ef5 2023-07-11 15:30:48,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/.tmp/cf/b0c3b749f98846dfba91d860356df326 2023-07-11 15:30:48,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/.tmp/cf/21994aac84634d3498076e6090a54ef5 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf/21994aac84634d3498076e6090a54ef5 2023-07-11 15:30:48,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/.tmp/cf/b0c3b749f98846dfba91d860356df326 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf/b0c3b749f98846dfba91d860356df326 2023-07-11 15:30:48,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf/21994aac84634d3498076e6090a54ef5, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 15:30:48,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf/b0c3b749f98846dfba91d860356df326, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 15:30:48,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 203f77b62d93e722f30bf36082b05ebf in 32ms, sequenceid=5, compaction requested=false 2023-07-11 15:30:48,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 15:30:48,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a728fa814ccc91a1e0073466df9cadbf in 32ms, sequenceid=5, compaction requested=false 2023-07-11 15:30:48,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 15:30:48,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 15:30:48,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 15:30:48,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:30:48,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:30:48,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf. 2023-07-11 15:30:48,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf. 2023-07-11 15:30:48,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a728fa814ccc91a1e0073466df9cadbf: 2023-07-11 15:30:48,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 203f77b62d93e722f30bf36082b05ebf: 2023-07-11 15:30:48,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:30:48,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=203f77b62d93e722f30bf36082b05ebf, regionState=CLOSED 2023-07-11 15:30:48,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089448836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089448836"}]},"ts":"1689089448836"} 2023-07-11 15:30:48,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:30:48,836 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a728fa814ccc91a1e0073466df9cadbf, regionState=CLOSED 2023-07-11 15:30:48,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689089448836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089448836"}]},"ts":"1689089448836"} 2023-07-11 15:30:48,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-11 15:30:48,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 203f77b62d93e722f30bf36082b05ebf, server=jenkins-hbase9.apache.org,33731,1689089363968 in 227 msec 2023-07-11 15:30:48,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-11 15:30:48,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a728fa814ccc91a1e0073466df9cadbf, server=jenkins-hbase9.apache.org,39487,1689089363864 in 223 msec 2023-07-11 15:30:48,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=203f77b62d93e722f30bf36082b05ebf, UNASSIGN in 246 msec 2023-07-11 15:30:48,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-11 15:30:48,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a728fa814ccc91a1e0073466df9cadbf, UNASSIGN in 258 msec 2023-07-11 15:30:48,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 15:30:48,884 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:30:49,016 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 15:30:49,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446415.a728fa814ccc91a1e0073466df9cadbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:49,021 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689089446415.203f77b62d93e722f30bf36082b05ebf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:49,021 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 15:30:49,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, ASSIGN}] 2023-07-11 15:30:49,094 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, ASSIGN 2023-07-11 15:30:49,095 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,39487,1689089363864; forceNewPlan=false, retain=false 2023-07-11 15:30:49,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 15:30:49,245 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 15:30:49,247 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=60f133c718f4e3492fecc6b0734160e3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,247 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689089449247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089449247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089449247"}]},"ts":"1689089449247"} 2023-07-11 15:30:49,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 60f133c718f4e3492fecc6b0734160e3, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:30:49,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:30:49,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60f133c718f4e3492fecc6b0734160e3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.', STARTKEY => '', ENDKEY => ''} 2023-07-11 15:30:49,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. service=AccessControlService 2023-07-11 15:30:49,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:30:49,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:30:49,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/.regioninfo 2023-07-11 15:30:49,416 INFO [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,417 DEBUG [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf 2023-07-11 15:30:49,417 DEBUG [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf 2023-07-11 15:30:49,417 INFO [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60f133c718f4e3492fecc6b0734160e3 columnFamilyName cf 2023-07-11 15:30:49,450 DEBUG [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] regionserver.HStore(539): loaded hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/21994aac84634d3498076e6090a54ef5.203f77b62d93e722f30bf36082b05ebf->hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf/21994aac84634d3498076e6090a54ef5-top 2023-07-11 15:30:49,475 DEBUG [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] regionserver.HStore(539): loaded hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/b0c3b749f98846dfba91d860356df326.a728fa814ccc91a1e0073466df9cadbf->hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf/b0c3b749f98846dfba91d860356df326-top 2023-07-11 15:30:49,476 INFO [StoreOpener-60f133c718f4e3492fecc6b0734160e3-1] regionserver.HStore(310): Store=60f133c718f4e3492fecc6b0734160e3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:30:49,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:30:49,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 60f133c718f4e3492fecc6b0734160e3; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66269597, jitterRate=-0.012506052851676941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:30:49,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 60f133c718f4e3492fecc6b0734160e3: 2023-07-11 15:30:49,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3., pid=77, masterSystemTime=1689089449401 2023-07-11 15:30:49,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.,because compaction is disabled. 2023-07-11 15:30:49,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:30:49,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:30:49,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=60f133c718f4e3492fecc6b0734160e3, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,499 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689089449498"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089449498"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089449498"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089449498"}]},"ts":"1689089449498"} 2023-07-11 15:30:49,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 15:30:49,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 60f133c718f4e3492fecc6b0734160e3, server=jenkins-hbase9.apache.org,39487,1689089363864 in 251 msec 2023-07-11 15:30:49,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-11 15:30:49,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, ASSIGN in 411 msec 2023-07-11 15:30:49,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a728fa814ccc91a1e0073466df9cadbf, 203f77b62d93e722f30bf36082b05ebf], force=true in 938 msec 2023-07-11 15:30:49,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 15:30:49,685 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-11 15:30:49,686 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 15:30:49,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089449686 (current time:1689089449686). 2023-07-11 15:30:49,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:30:49,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x4c99444e to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:49,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@320602a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:49,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:49,715 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:49,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c99444e to 127.0.0.1:55301 2023-07-11 15:30:49,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:49,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x75352fdd to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:30:49,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7388be01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:30:49,729 DEBUG [hconnection-0x7119f19a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:49,733 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:49,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:30:49,741 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:30:49,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75352fdd to 127.0.0.1:55301 2023-07-11 15:30:49,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:30:49,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 15:30:49,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:30:49,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 15:30:49,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 15:30:49,747 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 15:30:49,748 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689090049748 2023-07-11 15:30:49,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 15:30:49,753 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:30:49,753 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:30:49,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 15:30:49,754 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 15:30:49,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-11 15:30:49,757 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 15:30:49,759 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689090049759 2023-07-11 15:30:49,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,780 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 15:30:49,780 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:49,783 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-11 15:30:49,783 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-11 15:30:49,784 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,784 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,785 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:49,785 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:49,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:49,786 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:49,785 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:49,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 15:30:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 15:30:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 15:30:49,788 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 15:30:49,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 15:30:49,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 15:30:49,791 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,791 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:30:49,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,792 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 15:30:49,793 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:49,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:49,795 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:30:49,796 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 15:30:49,797 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 15:30:49,798 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 15:30:49,797 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 15:30:49,798 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 15:30:49,798 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 15:30:49,799 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,799 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:49,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:49,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,800 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:30:49,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:49,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-11 15:30:49,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@503fdd9c[Count = 0] remaining members to acquire global barrier 2023-07-11 15:30:49,802 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-11 15:30:49,802 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 15:30:49,804 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 15:30:49,804 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,804 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:30:49,804 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 15:30:49,804 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 15:30:49,804 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:30:49,804 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:30:49,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,805 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 15:30:49,806 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:30:49,806 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:30:49,806 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:30:49,806 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. started... 2023-07-11 15:30:49,808 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60f133c718f4e3492fecc6b0734160e3: 2023-07-11 15:30:49,808 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 15:30:49,808 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:49,808 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 15:30:49,808 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 15:30:49,808 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,808 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:49,808 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:30:49,808 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 15:30:49,813 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/21994aac84634d3498076e6090a54ef5.203f77b62d93e722f30bf36082b05ebf->hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf/21994aac84634d3498076e6090a54ef5-top, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/b0c3b749f98846dfba91d860356df326.a728fa814ccc91a1e0073466df9cadbf->hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf/b0c3b749f98846dfba91d860356df326-top] hfiles 2023-07-11 15:30:49,813 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/21994aac84634d3498076e6090a54ef5.203f77b62d93e722f30bf36082b05ebf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,814 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/b0c3b749f98846dfba91d860356df326.a728fa814ccc91a1e0073466df9cadbf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,853 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:49,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 15:30:49,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:30:49,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:30:49,859 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. completed. 2023-07-11 15:30:49,859 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:30:49,859 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:30:49,859 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:30:49,859 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,859 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 15:30:49,859 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:30:49,864 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 15:30:49,864 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:49,864 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,864 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 15:30:49,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:49,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:30:49,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-11 15:30:49,875 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-11 15:30:49,875 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:30:49,875 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:30:49,875 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,875 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:30:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:49,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:49,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:49,877 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:30:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:49,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:49,878 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:30:49,879 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:30:49,881 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,881 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,881 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,885 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:49,885 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:49,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:49,885 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:49,885 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:30:49,885 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:49,885 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:49,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,887 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:30:49,887 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:30:49,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:30:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:30:49,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:49,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:49,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:30:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:30:49,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-11 15:30:49,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,996 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:49,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689089449748Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689089449886 (+138 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689089449886Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689089449891 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689089449910 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689089449995 (+85 ms) 2023-07-11 15:30:49,999 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 15:30:50,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 247 msec 2023-07-11 15:30:50,055 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:30:50,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 15:30:50,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:30:50,057 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057 2023-07-11 15:30:50,057 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46655, tgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057, rawTgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:30:50,084 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:30:50,085 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_928663016_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:50,085 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-11 15:30:50,102 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:30:50,201 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,201 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,202 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,203 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,203 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,203 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,204 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,278 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-8140661805065085277.jar 2023-07-11 15:30:50,278 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,278 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,279 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,279 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,279 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,280 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:30:50,280 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:30:50,280 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:30:50,281 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:30:50,281 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:30:50,282 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:30:50,282 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:30:50,283 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:30:50,283 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:30:50,283 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:30:50,284 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:30:50,284 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:50,284 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:50,285 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:50,285 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:50,285 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:30:50,286 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:50,286 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:30:51,214 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:30:51,218 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-11 15:30:51,220 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-11 15:30:51,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:30:51,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:30:51,364 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0005_000001 (auth:SIMPLE) 2023-07-11 15:30:54,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:30:57,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0005_000001 (auth:SIMPLE) 2023-07-11 15:30:59,680 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0005_000001 (auth:SIMPLE) 2023-07-11 15:31:06,503 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:31:06,509 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:31:06,525 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,525 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:31:06,526 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:31:06,526 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,526 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 15:31:06,527 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 15:31:06,527 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,527 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 15:31:06,527 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089450057/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 15:31:06,533 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 15:31:06,538 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089466538"}]},"ts":"1689089466538"} 2023-07-11 15:31:06,539 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-11 15:31:06,541 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-11 15:31:06,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, UNASSIGN}] 2023-07-11 15:31:06,543 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, UNASSIGN 2023-07-11 15:31:06,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=60f133c718f4e3492fecc6b0734160e3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:06,544 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689089466544"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089466544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089466544"}]},"ts":"1689089466544"} 2023-07-11 15:31:06,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 60f133c718f4e3492fecc6b0734160e3, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:31:06,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 15:31:06,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:31:06,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 60f133c718f4e3492fecc6b0734160e3, disabling compactions & flushes 2023-07-11 15:31:06,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:31:06,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:31:06,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. after waiting 0 ms 2023-07-11 15:31:06,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:31:06,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-11 15:31:06,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:06,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3. 2023-07-11 15:31:06,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 60f133c718f4e3492fecc6b0734160e3: 2023-07-11 15:31:06,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:31:06,718 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=60f133c718f4e3492fecc6b0734160e3, regionState=CLOSED 2023-07-11 15:31:06,719 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689089466718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089466718"}]},"ts":"1689089466718"} 2023-07-11 15:31:06,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-11 15:31:06,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 60f133c718f4e3492fecc6b0734160e3, server=jenkins-hbase9.apache.org,39487,1689089363864 in 178 msec 2023-07-11 15:31:06,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-11 15:31:06,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=60f133c718f4e3492fecc6b0734160e3, UNASSIGN in 184 msec 2023-07-11 15:31:06,727 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089466727"}]},"ts":"1689089466727"} 2023-07-11 15:31:06,732 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-11 15:31:06,734 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-11 15:31:06,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 202 msec 2023-07-11 15:31:06,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 15:31:06,841 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-11 15:31:06,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,846 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,847 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,849 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,852 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,852 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,853 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,853 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 15:31:06,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 15:31:06,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 15:31:06,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:06,855 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:06,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:06,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:06,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:06,857 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:31:06,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 15:31:06,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:06,862 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:31:06,862 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:31:06,865 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/recovered.edits] 2023-07-11 15:31:06,874 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/recovered.edits] 2023-07-11 15:31:06,879 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/recovered.edits] 2023-07-11 15:31:06,883 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/21994aac84634d3498076e6090a54ef5.203f77b62d93e722f30bf36082b05ebf to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/21994aac84634d3498076e6090a54ef5.203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:31:06,885 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf/21994aac84634d3498076e6090a54ef5 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/cf/21994aac84634d3498076e6090a54ef5 2023-07-11 15:31:06,885 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf/b0c3b749f98846dfba91d860356df326 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/cf/b0c3b749f98846dfba91d860356df326 2023-07-11 15:31:06,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/b0c3b749f98846dfba91d860356df326.a728fa814ccc91a1e0073466df9cadbf to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/cf/b0c3b749f98846dfba91d860356df326.a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:31:06,889 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/recovered.edits/8.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf/recovered.edits/8.seqid 2023-07-11 15:31:06,889 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/recovered.edits/12.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3/recovered.edits/12.seqid 2023-07-11 15:31:06,890 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/recovered.edits/8.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf/recovered.edits/8.seqid 2023-07-11 15:31:06,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/203f77b62d93e722f30bf36082b05ebf 2023-07-11 15:31:06,890 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/60f133c718f4e3492fecc6b0734160e3 2023-07-11 15:31:06,891 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a728fa814ccc91a1e0073466df9cadbf 2023-07-11 15:31:06,891 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 15:31:06,893 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,914 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-11 15:31:06,924 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-11 15:31:06,926 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,926 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-11 15:31:06,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089466926"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:06,932 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 15:31:06,932 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 60f133c718f4e3492fecc6b0734160e3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689089446416.60f133c718f4e3492fecc6b0734160e3.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 15:31:06,932 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-11 15:31:06,932 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089466932"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:06,935 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-11 15:31:06,937 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:06,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 95 msec 2023-07-11 15:31:06,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 15:31:06,964 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-11 15:31:06,965 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:06,966 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:06,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:06,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 15:31:06,971 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089466971"}]},"ts":"1689089466971"} 2023-07-11 15:31:06,972 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-11 15:31:06,974 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-11 15:31:06,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, UNASSIGN}] 2023-07-11 15:31:06,977 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, UNASSIGN 2023-07-11 15:31:06,977 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, UNASSIGN 2023-07-11 15:31:06,977 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8ddfe2fd58a8315d64ba95ae6272b489, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:06,978 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=358adb390912fd1598b90adf545a881e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:06,978 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089466977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089466977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089466977"}]},"ts":"1689089466977"} 2023-07-11 15:31:06,978 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089466977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089466977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089466977"}]},"ts":"1689089466977"} 2023-07-11 15:31:06,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 8ddfe2fd58a8315d64ba95ae6272b489, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:31:06,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 358adb390912fd1598b90adf545a881e, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:31:07,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 15:31:07,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:31:07,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8ddfe2fd58a8315d64ba95ae6272b489, disabling compactions & flushes 2023-07-11 15:31:07,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:31:07,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:31:07,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. after waiting 0 ms 2023-07-11 15:31:07,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:31:07,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 358adb390912fd1598b90adf545a881e 2023-07-11 15:31:07,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 358adb390912fd1598b90adf545a881e, disabling compactions & flushes 2023-07-11 15:31:07,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:31:07,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:31:07,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. after waiting 0 ms 2023-07-11 15:31:07,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:31:07,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:31:07,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:07,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489. 2023-07-11 15:31:07,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8ddfe2fd58a8315d64ba95ae6272b489: 2023-07-11 15:31:07,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:31:07,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:07,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e. 2023-07-11 15:31:07,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 358adb390912fd1598b90adf545a881e: 2023-07-11 15:31:07,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:31:07,175 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8ddfe2fd58a8315d64ba95ae6272b489, regionState=CLOSED 2023-07-11 15:31:07,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089467175"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089467175"}]},"ts":"1689089467175"} 2023-07-11 15:31:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 358adb390912fd1598b90adf545a881e 2023-07-11 15:31:07,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=358adb390912fd1598b90adf545a881e, regionState=CLOSED 2023-07-11 15:31:07,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689089467176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089467176"}]},"ts":"1689089467176"} 2023-07-11 15:31:07,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-11 15:31:07,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 8ddfe2fd58a8315d64ba95ae6272b489, server=jenkins-hbase9.apache.org,39487,1689089363864 in 198 msec 2023-07-11 15:31:07,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-11 15:31:07,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 358adb390912fd1598b90adf545a881e, server=jenkins-hbase9.apache.org,33731,1689089363968 in 198 msec 2023-07-11 15:31:07,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8ddfe2fd58a8315d64ba95ae6272b489, UNASSIGN in 205 msec 2023-07-11 15:31:07,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-11 15:31:07,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=358adb390912fd1598b90adf545a881e, UNASSIGN in 205 msec 2023-07-11 15:31:07,182 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089467182"}]},"ts":"1689089467182"} 2023-07-11 15:31:07,183 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-11 15:31:07,189 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-11 15:31:07,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 224 msec 2023-07-11 15:31:07,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 15:31:07,273 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-11 15:31:07,274 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,279 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,280 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,283 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,283 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,283 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,283 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 15:31:07,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:31:07,283 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e 2023-07-11 15:31:07,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 15:31:07,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 15:31:07,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 15:31:07,286 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,286 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,286 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,286 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,286 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,286 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,287 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,287 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/recovered.edits] 2023-07-11 15:31:07,287 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/recovered.edits] 2023-07-11 15:31:07,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 15:31:07,292 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf/88c940ac480340f1aa8486af73ac27f5 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/cf/88c940ac480340f1aa8486af73ac27f5 2023-07-11 15:31:07,292 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf/2d613f3c061c42608f7a704250640bbd to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/cf/2d613f3c061c42608f7a704250640bbd 2023-07-11 15:31:07,297 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489/recovered.edits/9.seqid 2023-07-11 15:31:07,298 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8ddfe2fd58a8315d64ba95ae6272b489 2023-07-11 15:31:07,298 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e/recovered.edits/9.seqid 2023-07-11 15:31:07,299 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/358adb390912fd1598b90adf545a881e 2023-07-11 15:31:07,299 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 15:31:07,299 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-11 15:31:07,300 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-11 15:31:07,305 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307112fe8b2049a654bc69d5e25defa4b0078 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307112fe8b2049a654bc69d5e25defa4b0078 2023-07-11 15:31:07,311 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230711b41a7ed4687a4dcaa438060620e36579 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230711b41a7ed4687a4dcaa438060620e36579 2023-07-11 15:31:07,311 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-11 15:31:07,314 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,320 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-11 15:31:07,329 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-11 15:31:07,331 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,331 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-11 15:31:07,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089467331"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:07,331 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089467331"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:07,334 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 15:31:07,334 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8ddfe2fd58a8315d64ba95ae6272b489, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689089443627.8ddfe2fd58a8315d64ba95ae6272b489.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 358adb390912fd1598b90adf545a881e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689089443627.358adb390912fd1598b90adf545a881e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 15:31:07,334 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-11 15:31:07,334 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089467334"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:07,336 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-11 15:31:07,338 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 64 msec 2023-07-11 15:31:07,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 15:31:07,397 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-11 15:31:07,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 15:31:07,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,429 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 15:31:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 15:31:07,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-11 15:31:07,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 15:31:07,463 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:43662 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:39843 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4215 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:44286 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:40569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690840835_1 at /127.0.0.1:43636 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:55566 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=718 (was 619) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=6125 (was 6721) 2023-07-11 15:31:07,463 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-11 15:31:07,494 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=718, ProcessCount=180, AvailableMemoryMB=6123 2023-07-11 15:31:07,495 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-11 15:31:07,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 15:31:07,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:07,500 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:31:07,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-11 15:31:07,501 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:31:07,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 15:31:07,504 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,504 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,505 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 empty. 2023-07-11 15:31:07,505 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 empty. 2023-07-11 15:31:07,506 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,506 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,506 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 15:31:07,526 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 15:31:07,527 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d137e2944996406ae8bc58f871ba824, NAME => 'testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:31:07,527 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => feb905bb6d24b9ff8dcc0017bcae5766, NAME => 'testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:31:07,565 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:07,566 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7d137e2944996406ae8bc58f871ba824, disabling compactions & flushes 2023-07-11 15:31:07,566 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,566 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,566 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. after waiting 0 ms 2023-07-11 15:31:07,566 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,566 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,566 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7d137e2944996406ae8bc58f871ba824: 2023-07-11 15:31:07,567 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:07,567 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing feb905bb6d24b9ff8dcc0017bcae5766, disabling compactions & flushes 2023-07-11 15:31:07,567 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,567 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,567 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. after waiting 0 ms 2023-07-11 15:31:07,567 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,568 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,568 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for feb905bb6d24b9ff8dcc0017bcae5766: 2023-07-11 15:31:07,570 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:31:07,571 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089467571"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089467571"}]},"ts":"1689089467571"} 2023-07-11 15:31:07,571 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089467571"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089467571"}]},"ts":"1689089467571"} 2023-07-11 15:31:07,577 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:31:07,578 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:31:07,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089467578"}]},"ts":"1689089467578"} 2023-07-11 15:31:07,582 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 15:31:07,586 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:31:07,587 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:31:07,587 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:31:07,587 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:31:07,587 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:31:07,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, ASSIGN}] 2023-07-11 15:31:07,591 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, ASSIGN 2023-07-11 15:31:07,591 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, ASSIGN 2023-07-11 15:31:07,592 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42251,1689089363923; forceNewPlan=false, retain=false 2023-07-11 15:31:07,592 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33731,1689089363968; forceNewPlan=false, retain=false 2023-07-11 15:31:07,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 15:31:07,742 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:31:07,746 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7d137e2944996406ae8bc58f871ba824, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:07,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=feb905bb6d24b9ff8dcc0017bcae5766, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:07,746 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089467746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089467746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089467746"}]},"ts":"1689089467746"} 2023-07-11 15:31:07,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089467746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089467746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089467746"}]},"ts":"1689089467746"} 2023-07-11 15:31:07,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 7d137e2944996406ae8bc58f871ba824, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:31:07,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure feb905bb6d24b9ff8dcc0017bcae5766, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:31:07,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 15:31:07,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => feb905bb6d24b9ff8dcc0017bcae5766, NAME => 'testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 15:31:07,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. service=AccessControlService 2023-07-11 15:31:07,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:31:07,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:07,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d137e2944996406ae8bc58f871ba824, NAME => 'testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 15:31:07,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. service=AccessControlService 2023-07-11 15:31:07,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:31:07,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:07,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,911 INFO [StoreOpener-feb905bb6d24b9ff8dcc0017bcae5766-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,914 INFO [StoreOpener-7d137e2944996406ae8bc58f871ba824-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,915 DEBUG [StoreOpener-feb905bb6d24b9ff8dcc0017bcae5766-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf 2023-07-11 15:31:07,915 DEBUG [StoreOpener-feb905bb6d24b9ff8dcc0017bcae5766-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf 2023-07-11 15:31:07,915 INFO [StoreOpener-feb905bb6d24b9ff8dcc0017bcae5766-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb905bb6d24b9ff8dcc0017bcae5766 columnFamilyName cf 2023-07-11 15:31:07,916 DEBUG [StoreOpener-7d137e2944996406ae8bc58f871ba824-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf 2023-07-11 15:31:07,916 DEBUG [StoreOpener-7d137e2944996406ae8bc58f871ba824-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf 2023-07-11 15:31:07,916 INFO [StoreOpener-7d137e2944996406ae8bc58f871ba824-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d137e2944996406ae8bc58f871ba824 columnFamilyName cf 2023-07-11 15:31:07,917 INFO [StoreOpener-feb905bb6d24b9ff8dcc0017bcae5766-1] regionserver.HStore(310): Store=feb905bb6d24b9ff8dcc0017bcae5766/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:31:07,917 INFO [StoreOpener-7d137e2944996406ae8bc58f871ba824-1] regionserver.HStore(310): Store=7d137e2944996406ae8bc58f871ba824/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:31:07,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:07,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:31:07,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened feb905bb6d24b9ff8dcc0017bcae5766; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67353228, jitterRate=0.0036413073539733887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:31:07,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for feb905bb6d24b9ff8dcc0017bcae5766: 2023-07-11 15:31:07,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766., pid=94, masterSystemTime=1689089467901 2023-07-11 15:31:07,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:31:07,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:07,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7d137e2944996406ae8bc58f871ba824; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62328636, jitterRate=-0.071230947971344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:31:07,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7d137e2944996406ae8bc58f871ba824: 2023-07-11 15:31:07,930 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=feb905bb6d24b9ff8dcc0017bcae5766, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:07,930 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089467930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089467930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089467930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089467930"}]},"ts":"1689089467930"} 2023-07-11 15:31:07,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824., pid=93, masterSystemTime=1689089467901 2023-07-11 15:31:07,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:07,932 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7d137e2944996406ae8bc58f871ba824, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:07,932 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089467932"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089467932"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089467932"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089467932"}]},"ts":"1689089467932"} 2023-07-11 15:31:07,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-11 15:31:07,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure feb905bb6d24b9ff8dcc0017bcae5766, server=jenkins-hbase9.apache.org,33731,1689089363968 in 182 msec 2023-07-11 15:31:07,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, ASSIGN in 347 msec 2023-07-11 15:31:07,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-11 15:31:07,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 7d137e2944996406ae8bc58f871ba824, server=jenkins-hbase9.apache.org,42251,1689089363923 in 187 msec 2023-07-11 15:31:07,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-11 15:31:07,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, ASSIGN in 354 msec 2023-07-11 15:31:07,945 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:31:07,945 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089467945"}]},"ts":"1689089467945"} 2023-07-11 15:31:07,946 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 15:31:07,948 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:31:07,948 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-11 15:31:07,950 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 15:31:07,951 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,951 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,951 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,951 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:07,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:07,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:07,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:07,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:07,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 458 msec 2023-07-11 15:31:08,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 15:31:08,105 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-11 15:31:08,107 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:08,107 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:08,110 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:31:08,127 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:31:08,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089468127 (current time:1689089468127). 2023-07-11 15:31:08,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:31:08,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x681e3730 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59425723, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:08,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:08,147 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:08,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x681e3730 to 127.0.0.1:55301 2023-07-11 15:31:08,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:08,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x2b9a3b73 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:08,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32a43e87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:08,253 DEBUG [hconnection-0x79948cbf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:08,257 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:08,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:08,263 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:08,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b9a3b73 to 127.0.0.1:55301 2023-07-11 15:31:08,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:08,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 15:31:08,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:31:08,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:31:08,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:31:08,270 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:31:08,271 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689090068271 2023-07-11 15:31:08,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:31:08,271 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:08,273 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:31:08,273 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:31:08,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 15:31:08,275 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:31:08,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-11 15:31:08,281 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 15:31:08,282 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689090068282 2023-07-11 15:31:08,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,300 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-11 15:31:08,300 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,305 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 15:31:08,305 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 15:31:08,305 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,305 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,316 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,316 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,316 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,316 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,316 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,316 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,317 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,317 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 15:31:08,318 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 15:31:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 15:31:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,318 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 15:31:08,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,329 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 15:31:08,329 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,329 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 15:31:08,329 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 15:31:08,331 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 15:31:08,331 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,331 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,332 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 15:31:08,331 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 15:31:08,334 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 15:31:08,334 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 15:31:08,334 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 15:31:08,334 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 15:31:08,334 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 15:31:08,334 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 15:31:08,337 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,337 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,342 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,342 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,343 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:08,344 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,344 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,344 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:08,344 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,344 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,344 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:08,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 15:31:08,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79592371[Count = 1] remaining members to acquire global barrier 2023-07-11 15:31:08,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 15:31:08,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79592371[Count = 0] remaining members to acquire global barrier 2023-07-11 15:31:08,352 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 15:31:08,352 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,353 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:31:08,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 15:31:08,354 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,354 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:31:08,354 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:31:08,354 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. started... 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:08,354 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:08,354 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:08,354 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d137e2944996406ae8bc58f871ba824: 2023-07-11 15:31:08,354 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. started... 2023-07-11 15:31:08,356 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,356 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for feb905bb6d24b9ff8dcc0017bcae5766: 2023-07-11 15:31:08,356 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:08,356 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:31:08,357 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,357 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:08,357 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:31:08,357 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 15:31:08,357 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,357 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 15:31:08,373 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:08,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:31:08,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:08,374 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:31:08,419 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. completed. 2023-07-11 15:31:08,420 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:08,420 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. completed. 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 15:31:08,420 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:31:08,420 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:31:08,423 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,423 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 15:31:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,423 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,423 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 15:31:08,425 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 15:31:08,425 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,425 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,425 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 15:31:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:31:08,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 15:31:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:31:08,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 15:31:08,437 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 15:31:08,437 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:31:08,437 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:31:08,438 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,438 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:31:08,439 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,440 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,440 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,440 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,440 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,441 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,442 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,442 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,444 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,445 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,445 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,450 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,449 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:08,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,450 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,450 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,450 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,450 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,450 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,450 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,451 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:31:08,451 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,451 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,451 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 15:31:08,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,467 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-11 15:31:08,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 15:31:08,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,506 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689089468271Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689089468459 (+188 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689089468459Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689089468459Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689089468462 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689089468474 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689089468505 (+31 ms) 2023-07-11 15:31:08,509 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 15:31:08,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 237 msec 2023-07-11 15:31:08,575 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:08,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:31:08,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:31:08,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42251] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:31:08,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33731] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:31:08,583 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:08,583 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:08,583 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:31:08,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:31:08,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089468594 (current time:1689089468594). 2023-07-11 15:31:08,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:31:08,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x53119f7f to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:08,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ebd10d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:08,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:08,626 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:08,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53119f7f to 127.0.0.1:55301 2023-07-11 15:31:08,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:08,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x2b0f0421 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:08,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@743a9c58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:08,634 DEBUG [hconnection-0x12e709a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:08,635 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:08,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:08,645 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:08,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b0f0421 to 127.0.0.1:55301 2023-07-11 15:31:08,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:08,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 15:31:08,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:31:08,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:31:08,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:31:08,650 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:31:08,651 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689090068651 2023-07-11 15:31:08,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:08,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 15:31:08,652 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:31:08,652 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:31:08,653 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 15:31:08,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 15:31:08,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-07-11 15:31:08,655 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 15:31:08,655 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689090068655 2023-07-11 15:31:08,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,669 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-11 15:31:08,669 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,670 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 15:31:08,671 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 15:31:08,671 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,671 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,673 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,673 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,673 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,673 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,674 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,674 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,674 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,674 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 15:31:08,675 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 15:31:08,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,678 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 15:31:08,678 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 15:31:08,678 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 15:31:08,678 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,678 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,678 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:08,680 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 15:31:08,683 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 15:31:08,683 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 15:31:08,679 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 15:31:08,683 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 15:31:08,683 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 15:31:08,684 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 15:31:08,684 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 15:31:08,684 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 15:31:08,685 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,685 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,685 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,686 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:08,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,686 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:08,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64eb4e9a[Count = 1] remaining members to acquire global barrier 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 15:31:08,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64eb4e9a[Count = 0] remaining members to acquire global barrier 2023-07-11 15:31:08,690 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 15:31:08,690 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,695 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:31:08,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,695 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:31:08,695 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:08,696 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:08,696 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:08,696 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:08,696 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:08,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,696 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:08,696 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 15:31:08,696 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 15:31:08,696 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. started... 2023-07-11 15:31:08,696 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,696 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:31:08,696 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:31:08,696 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7d137e2944996406ae8bc58f871ba824 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-11 15:31:08,696 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. started... 2023-07-11 15:31:08,696 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing feb905bb6d24b9ff8dcc0017bcae5766 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-11 15:31:08,698 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 15:31:08,698 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,698 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 15:31:08,715 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711fb6a584b0dd8417ea1bc1b9b31cf7334 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711fb6a584b0dd8417ea1bc1b9b31cf7334 2023-07-11 15:31:08,716 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307117ece910cd99341a4a5df0212435a2928 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307117ece910cd99341a4a5df0212435a2928 2023-07-11 15:31:08,726 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/.tmp/cf/92c423182b894f96824ae2e5d989a252 2023-07-11 15:31:08,728 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/.tmp/cf/3ab139ae296f441a937986655b0653a2 2023-07-11 15:31:08,731 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/.tmp/cf/92c423182b894f96824ae2e5d989a252 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf/92c423182b894f96824ae2e5d989a252 2023-07-11 15:31:08,740 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf/92c423182b894f96824ae2e5d989a252, entries=45, sequenceid=6, filesize=12.7 K 2023-07-11 15:31:08,741 INFO [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for feb905bb6d24b9ff8dcc0017bcae5766 in 45ms, sequenceid=6, compaction requested=false 2023-07-11 15:31:08,744 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for feb905bb6d24b9ff8dcc0017bcae5766: 2023-07-11 15:31:08,744 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,744 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:08,744 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf/92c423182b894f96824ae2e5d989a252] hfiles 2023-07-11 15:31:08,744 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf/92c423182b894f96824ae2e5d989a252 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,745 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/.tmp/cf/3ab139ae296f441a937986655b0653a2 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf/3ab139ae296f441a937986655b0653a2 2023-07-11 15:31:08,749 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf/3ab139ae296f441a937986655b0653a2, entries=5, sequenceid=6, filesize=5.8 K 2023-07-11 15:31:08,750 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 7d137e2944996406ae8bc58f871ba824 in 54ms, sequenceid=6, compaction requested=false 2023-07-11 15:31:08,750 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d137e2944996406ae8bc58f871ba824: 2023-07-11 15:31:08,751 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,751 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:08,751 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf/3ab139ae296f441a937986655b0653a2] hfiles 2023-07-11 15:31:08,751 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf/3ab139ae296f441a937986655b0653a2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,753 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:08,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:31:08,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:08,755 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:31:08,772 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. completed. 2023-07-11 15:31:08,772 DEBUG [rs(jenkins-hbase9.apache.org,33731,1689089363968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:08,772 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:08,772 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:08,772 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,772 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 15:31:08,773 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:31:08,777 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. completed. 2023-07-11 15:31:08,777 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:08,777 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:08,777 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:08,777 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,777 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 15:31:08,777 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:31:08,783 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 15:31:08,783 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,783 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,783 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 15:31:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,791 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 15:31:08,791 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,791 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,791 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 15:31:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,33731,1689089363968': 2023-07-11 15:31:08,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 15:31:08,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:31:08,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 15:31:08,800 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 15:31:08,800 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:31:08,800 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:31:08,800 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,800 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:08,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,803 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,803 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:08,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,805 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:08,805 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,806 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,808 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,808 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,808 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,808 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:08,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,809 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:08,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,808 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,809 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:31:08,809 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:08,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:08,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:08,809 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:08,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,809 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:08,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:08,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,811 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711fb6a584b0dd8417ea1bc1b9b31cf7334, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307117ece910cd99341a4a5df0212435a2928] mob files 2023-07-11 15:31:08,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711fb6a584b0dd8417ea1bc1b9b31cf7334 2023-07-11 15:31:08,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307117ece910cd99341a4a5df0212435a2928 2023-07-11 15:31:08,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:08,955 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:08,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:31:08,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:08,956 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:31:09,256 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:09,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:31:09,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:09,258 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 15:31:09,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 15:31:09,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:09,269 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:09,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689089468651Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689089468818 (+167 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689089468818Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689089468818Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689089468821 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689089468836 (+15 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689089469268 (+432 ms) 2023-07-11 15:31:09,272 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 15:31:09,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 620 msec 2023-07-11 15:31:09,758 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:09,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 15:31:09,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:31:09,761 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761 2023-07-11 15:31:09,761 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46655, tgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761, rawTgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:31:09,798 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:31:09,798 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_35964788_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:09,798 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-11 15:31:09,819 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:09,854 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,854 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,855 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,856 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,923 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-96831196752198636.jar 2023-07-11 15:31:09,923 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,924 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,924 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,924 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,924 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,925 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:09,925 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:31:09,925 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:31:09,926 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:31:09,926 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:31:09,926 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:31:09,927 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:31:09,927 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:31:09,927 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:31:09,928 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:31:09,928 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:31:09,929 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:09,929 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:09,929 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:31:09,929 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:09,930 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:09,930 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:31:09,930 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:31:10,618 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:31:10,621 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-11 15:31:11,109 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:31:11,109 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:31:11,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0005_000001 (auth:SIMPLE) 2023-07-11 15:31:11,502 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0006_000001 (auth:SIMPLE) 2023-07-11 15:31:12,383 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:31:18,377 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0006_000001 (auth:SIMPLE) 2023-07-11 15:31:20,882 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:31:20,885 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:31:20,891 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:20,891 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:31:20,892 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:31:20,892 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:20,893 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 15:31:20,893 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 15:31:20,893 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:20,893 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 15:31:20,894 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089469761/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 15:31:20,899 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-11 15:31:20,899 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-11 15:31:20,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:20,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 15:31:20,904 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089480904"}]},"ts":"1689089480904"} 2023-07-11 15:31:20,906 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 15:31:20,907 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-11 15:31:20,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, UNASSIGN}] 2023-07-11 15:31:20,909 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, UNASSIGN 2023-07-11 15:31:20,914 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, UNASSIGN 2023-07-11 15:31:20,914 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=feb905bb6d24b9ff8dcc0017bcae5766, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:20,914 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089480914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089480914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089480914"}]},"ts":"1689089480914"} 2023-07-11 15:31:20,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7d137e2944996406ae8bc58f871ba824, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:20,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089480915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089480915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089480915"}]},"ts":"1689089480915"} 2023-07-11 15:31:20,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure feb905bb6d24b9ff8dcc0017bcae5766, server=jenkins-hbase9.apache.org,33731,1689089363968}] 2023-07-11 15:31:20,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 7d137e2944996406ae8bc58f871ba824, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:31:21,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 15:31:21,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:21,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:21,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7d137e2944996406ae8bc58f871ba824, disabling compactions & flushes 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing feb905bb6d24b9ff8dcc0017bcae5766, disabling compactions & flushes 2023-07-11 15:31:21,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:21,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. after waiting 0 ms 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. after waiting 0 ms 2023-07-11 15:31:21,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:21,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:31:21,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:31:21,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:21,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824. 2023-07-11 15:31:21,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:21,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7d137e2944996406ae8bc58f871ba824: 2023-07-11 15:31:21,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766. 2023-07-11 15:31:21,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for feb905bb6d24b9ff8dcc0017bcae5766: 2023-07-11 15:31:21,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:21,086 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7d137e2944996406ae8bc58f871ba824, regionState=CLOSED 2023-07-11 15:31:21,086 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089481086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089481086"}]},"ts":"1689089481086"} 2023-07-11 15:31:21,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:21,086 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=feb905bb6d24b9ff8dcc0017bcae5766, regionState=CLOSED 2023-07-11 15:31:21,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689089481086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089481086"}]},"ts":"1689089481086"} 2023-07-11 15:31:21,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-11 15:31:21,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 7d137e2944996406ae8bc58f871ba824, server=jenkins-hbase9.apache.org,42251,1689089363923 in 169 msec 2023-07-11 15:31:21,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-11 15:31:21,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure feb905bb6d24b9ff8dcc0017bcae5766, server=jenkins-hbase9.apache.org,33731,1689089363968 in 172 msec 2023-07-11 15:31:21,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7d137e2944996406ae8bc58f871ba824, UNASSIGN in 181 msec 2023-07-11 15:31:21,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-11 15:31:21,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=feb905bb6d24b9ff8dcc0017bcae5766, UNASSIGN in 181 msec 2023-07-11 15:31:21,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089481091"}]},"ts":"1689089481091"} 2023-07-11 15:31:21,093 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 15:31:21,094 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-11 15:31:21,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 196 msec 2023-07-11 15:31:21,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 15:31:21,206 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-11 15:31:21,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,210 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,211 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,213 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,216 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,217 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,217 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,217 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 15:31:21,217 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:21,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 15:31:21,218 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:21,218 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 15:31:21,218 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 15:31:21,220 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/recovered.edits] 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,222 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 15:31:21,223 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/recovered.edits] 2023-07-11 15:31:21,228 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf/92c423182b894f96824ae2e5d989a252 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/cf/92c423182b894f96824ae2e5d989a252 2023-07-11 15:31:21,233 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf/3ab139ae296f441a937986655b0653a2 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/cf/3ab139ae296f441a937986655b0653a2 2023-07-11 15:31:21,233 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766/recovered.edits/9.seqid 2023-07-11 15:31:21,234 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/feb905bb6d24b9ff8dcc0017bcae5766 2023-07-11 15:31:21,237 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824/recovered.edits/9.seqid 2023-07-11 15:31:21,238 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7d137e2944996406ae8bc58f871ba824 2023-07-11 15:31:21,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 15:31:21,238 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-11 15:31:21,239 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-11 15:31:21,243 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711fb6a584b0dd8417ea1bc1b9b31cf7334 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230711fb6a584b0dd8417ea1bc1b9b31cf7334 2023-07-11 15:31:21,245 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307117ece910cd99341a4a5df0212435a2928 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307117ece910cd99341a4a5df0212435a2928 2023-07-11 15:31:21,246 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-11 15:31:21,248 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,250 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-11 15:31:21,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-11 15:31:21,253 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,254 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-11 15:31:21,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089481254"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:21,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089481254"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:21,256 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 15:31:21,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7d137e2944996406ae8bc58f871ba824, NAME => 'testtb-testEmptyExportFileSystemState,,1689089467496.7d137e2944996406ae8bc58f871ba824.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => feb905bb6d24b9ff8dcc0017bcae5766, NAME => 'testtb-testEmptyExportFileSystemState,1,1689089467496.feb905bb6d24b9ff8dcc0017bcae5766.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 15:31:21,256 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-11 15:31:21,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089481256"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:21,257 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-11 15:31:21,259 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 15:31:21,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 52 msec 2023-07-11 15:31:21,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 15:31:21,324 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-11 15:31:21,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-11 15:31:21,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:21,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-11 15:31:21,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-11 15:31:21,368 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:40940 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5019 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1744530a-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:42539 from appattempt_1689089373136_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_643313080_1 at /127.0.0.1:40924 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:58540 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:36425 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:40948 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=746 (was 718) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=5515 (was 6123) 2023-07-11 15:31:21,368 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-11 15:31:21,392 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=746, ProcessCount=180, AvailableMemoryMB=5513 2023-07-11 15:31:21,392 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-11 15:31:21,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 15:31:21,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:21,398 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 15:31:21,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-11 15:31:21,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 15:31:21,401 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 15:31:21,404 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,405 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,405 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 empty. 2023-07-11 15:31:21,405 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 empty. 2023-07-11 15:31:21,405 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,406 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,406 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 15:31:21,450 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-11 15:31:21,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 30c4ed0e96ea9bd9a8d266d02f2fd319, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:31:21,457 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 32b06631549ee640f9a2373538205140, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp 2023-07-11 15:31:21,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 15:31:21,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 32b06631549ee640f9a2373538205140, disabling compactions & flushes 2023-07-11 15:31:21,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 30c4ed0e96ea9bd9a8d266d02f2fd319, disabling compactions & flushes 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. after waiting 0 ms 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 32b06631549ee640f9a2373538205140: 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. after waiting 0 ms 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 30c4ed0e96ea9bd9a8d266d02f2fd319: 2023-07-11 15:31:21,530 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 15:31:21,531 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089481531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089481531"}]},"ts":"1689089481531"} 2023-07-11 15:31:21,531 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089481531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089481531"}]},"ts":"1689089481531"} 2023-07-11 15:31:21,536 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 15:31:21,537 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 15:31:21,537 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089481537"}]},"ts":"1689089481537"} 2023-07-11 15:31:21,538 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-11 15:31:21,543 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 15:31:21,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 15:31:21,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 15:31:21,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 15:31:21,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 15:31:21,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, ASSIGN}] 2023-07-11 15:31:21,548 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, ASSIGN 2023-07-11 15:31:21,548 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, ASSIGN 2023-07-11 15:31:21,549 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39487,1689089363864; forceNewPlan=false, retain=false 2023-07-11 15:31:21,549 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42251,1689089363923; forceNewPlan=false, retain=false 2023-07-11 15:31:21,699 INFO [jenkins-hbase9:35925] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 15:31:21,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=30c4ed0e96ea9bd9a8d266d02f2fd319, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:21,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089481703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089481703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089481703"}]},"ts":"1689089481703"} 2023-07-11 15:31:21,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=32b06631549ee640f9a2373538205140, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:21,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089481703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089481703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089481703"}]},"ts":"1689089481703"} 2023-07-11 15:31:21,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 30c4ed0e96ea9bd9a8d266d02f2fd319, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:31:21,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 32b06631549ee640f9a2373538205140, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:31:21,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 15:31:21,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30c4ed0e96ea9bd9a8d266d02f2fd319, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 15:31:21,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. service=AccessControlService 2023-07-11 15:31:21,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:31:21,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:21,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,874 INFO [StoreOpener-30c4ed0e96ea9bd9a8d266d02f2fd319-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,881 DEBUG [StoreOpener-30c4ed0e96ea9bd9a8d266d02f2fd319-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf 2023-07-11 15:31:21,881 DEBUG [StoreOpener-30c4ed0e96ea9bd9a8d266d02f2fd319-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf 2023-07-11 15:31:21,882 INFO [StoreOpener-30c4ed0e96ea9bd9a8d266d02f2fd319-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30c4ed0e96ea9bd9a8d266d02f2fd319 columnFamilyName cf 2023-07-11 15:31:21,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32b06631549ee640f9a2373538205140, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 15:31:21,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. service=AccessControlService 2023-07-11 15:31:21,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 15:31:21,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 15:31:21,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,890 INFO [StoreOpener-30c4ed0e96ea9bd9a8d266d02f2fd319-1] regionserver.HStore(310): Store=30c4ed0e96ea9bd9a8d266d02f2fd319/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:31:21,890 INFO [StoreOpener-32b06631549ee640f9a2373538205140-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,898 DEBUG [StoreOpener-32b06631549ee640f9a2373538205140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf 2023-07-11 15:31:21,898 DEBUG [StoreOpener-32b06631549ee640f9a2373538205140-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf 2023-07-11 15:31:21,898 INFO [StoreOpener-32b06631549ee640f9a2373538205140-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32b06631549ee640f9a2373538205140 columnFamilyName cf 2023-07-11 15:31:21,901 INFO [StoreOpener-32b06631549ee640f9a2373538205140-1] regionserver.HStore(310): Store=32b06631549ee640f9a2373538205140/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 15:31:21,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:21,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:31:21,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 30c4ed0e96ea9bd9a8d266d02f2fd319; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65738233, jitterRate=-0.020423993468284607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:31:21,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 30c4ed0e96ea9bd9a8d266d02f2fd319: 2023-07-11 15:31:21,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319., pid=108, masterSystemTime=1689089481859 2023-07-11 15:31:21,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:21,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=30c4ed0e96ea9bd9a8d266d02f2fd319, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:21,914 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089481914"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089481914"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089481914"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089481914"}]},"ts":"1689089481914"} 2023-07-11 15:31:21,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 32b06631549ee640f9a2373538205140 2023-07-11 15:31:21,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-11 15:31:21,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 30c4ed0e96ea9bd9a8d266d02f2fd319, server=jenkins-hbase9.apache.org,42251,1689089363923 in 211 msec 2023-07-11 15:31:21,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, ASSIGN in 374 msec 2023-07-11 15:31:21,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 15:31:21,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 32b06631549ee640f9a2373538205140; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74572957, jitterRate=0.11122365295886993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 15:31:21,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 32b06631549ee640f9a2373538205140: 2023-07-11 15:31:21,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140., pid=109, masterSystemTime=1689089481860 2023-07-11 15:31:21,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:21,926 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=32b06631549ee640f9a2373538205140, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:21,927 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089481926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689089481926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689089481926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689089481926"}]},"ts":"1689089481926"} 2023-07-11 15:31:21,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-11 15:31:21,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 32b06631549ee640f9a2373538205140, server=jenkins-hbase9.apache.org,39487,1689089363864 in 224 msec 2023-07-11 15:31:21,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-11 15:31:21,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, ASSIGN in 389 msec 2023-07-11 15:31:21,938 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 15:31:21,939 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089481939"}]},"ts":"1689089481939"} 2023-07-11 15:31:21,940 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-11 15:31:21,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 15:31:21,951 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-11 15:31:21,954 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 15:31:21,956 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,957 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,957 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,957 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:21,958 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:21,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:21,958 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:21,958 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:21,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:21,959 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 15:31:21,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 565 msec 2023-07-11 15:31:22,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 15:31:22,015 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-11 15:31:22,018 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,018 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:22,021 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:31:22,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 15:31:22,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089482046 (current time:1689089482046). 2023-07-11 15:31:22,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:31:22,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x7b5ba541 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:22,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a097053, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:22,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:22,075 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:22,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b5ba541 to 127.0.0.1:55301 2023-07-11 15:31:22,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:22,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x3c32d45f to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:22,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ae51f35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:22,103 DEBUG [hconnection-0x6b9f7fd2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:22,108 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:22,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:22,123 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:22,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c32d45f to 127.0.0.1:55301 2023-07-11 15:31:22,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:22,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 15:31:22,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:31:22,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 15:31:22,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 15:31:22,131 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 15:31:22,132 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689090082132 2023-07-11 15:31:22,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 15:31:22,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,138 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:31:22,138 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:31:22,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 15:31:22,139 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 15:31:22,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-11 15:31:22,152 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 15:31:22,153 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689090082153 2023-07-11 15:31:22,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,210 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 15:31:22,210 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,212 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 15:31:22,212 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 15:31:22,213 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,213 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,214 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,214 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,214 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,215 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,215 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,215 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,216 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,216 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 15:31:22,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,217 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 15:31:22,217 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 15:31:22,219 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 15:31:22,219 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,218 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 15:31:22,219 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 15:31:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,220 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 15:31:22,220 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 15:31:22,220 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 15:31:22,220 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 15:31:22,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 15:31:22,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,221 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 15:31:22,221 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,227 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 15:31:22,227 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 15:31:22,227 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 15:31:22,229 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,229 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,230 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,230 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:22,230 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,230 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,230 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,231 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 15:31:22,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62f39491[Count = 1] remaining members to acquire global barrier 2023-07-11 15:31:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 15:31:22,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62f39491[Count = 0] remaining members to acquire global barrier 2023-07-11 15:31:22,234 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 15:31:22,234 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,236 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,237 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 15:31:22,237 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,237 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,237 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 15:31:22,238 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:31:22,238 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:22,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:22,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:22,239 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:31:22,242 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,242 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:31:22,245 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:22,245 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:22,246 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:22,246 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. started... 2023-07-11 15:31:22,246 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 15:31:22,246 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:22,246 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 15:31:22,247 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 30c4ed0e96ea9bd9a8d266d02f2fd319: 2023-07-11 15:31:22,247 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,247 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:22,247 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:31:22,261 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:22,264 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:22,264 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:22,264 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. started... 2023-07-11 15:31:22,266 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32b06631549ee640f9a2373538205140: 2023-07-11 15:31:22,266 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,266 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:22,266 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 15:31:22,321 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. completed. 2023-07-11 15:31:22,321 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:22,322 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:22,322 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:22,322 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,322 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 15:31:22,322 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:31:22,324 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,324 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 15:31:22,324 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:22,324 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 15:31:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,327 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. completed. 2023-07-11 15:31:22,327 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:22,327 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:22,327 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:22,327 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,327 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 15:31:22,327 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:31:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,329 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,329 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 15:31:22,329 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:22,329 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 15:31:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:31:22,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 15:31:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:31:22,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 15:31:22,340 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 15:31:22,340 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:31:22,340 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:31:22,340 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,340 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:31:22,342 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,342 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,342 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:22,342 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,343 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:22,343 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,342 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:22,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:22,345 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,346 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,347 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,351 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,351 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,351 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,355 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:22,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,356 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,356 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,358 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 15:31:22,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:22,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:22,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:22,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,439 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:22,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:22,441 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:31:22,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 15:31:22,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,446 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689089482132Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689089482371 (+239 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689089482371Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689089482371Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689089482378 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689089482406 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689089482445 (+39 ms) 2023-07-11 15:31:22,449 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 15:31:22,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 315 msec 2023-07-11 15:31:22,741 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:31:22,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42251] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:31:22,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39487] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 15:31:22,749 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,749 DEBUG [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:22,749 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 15:31:22,760 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 15:31:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689089482760 (current time:1689089482760). 2023-07-11 15:31:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 15:31:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x1e91aa48 to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:22,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ee027a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:22,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:22,772 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:22,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e91aa48 to 127.0.0.1:55301 2023-07-11 15:31:22,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:22,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(139): Connect 0x7140594d to 127.0.0.1:55301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 15:31:22,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62106ec7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 15:31:22,782 DEBUG [hconnection-0x6dc2a03d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:22,786 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:22,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 15:31:22,792 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 15:31:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7140594d to 127.0.0.1:55301 2023-07-11 15:31:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:31:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 15:31:22,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 15:31:22,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 15:31:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 15:31:22,797 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 15:31:22,798 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689090082798 2023-07-11 15:31:22,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 15:31:22,799 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 15:31:22,800 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 15:31:22,801 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 15:31:22,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 15:31:22,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-11 15:31:22,803 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 15:31:22,804 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689090082804 2023-07-11 15:31:22,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,851 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 15:31:22,851 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,855 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 15:31:22,855 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 15:31:22,855 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,855 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,857 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,857 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,857 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,857 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:22,858 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,858 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,858 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,858 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 15:31:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 15:31:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 15:31:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 15:31:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,860 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 15:31:22,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,862 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 15:31:22,862 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,871 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 15:31:22,880 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 15:31:22,880 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,880 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 15:31:22,880 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 15:31:22,882 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33731,1689089363968' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 15:31:22,882 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 15:31:22,882 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 15:31:22,882 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 15:31:22,882 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 15:31:22,884 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 15:31:22,884 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 15:31:22,884 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 15:31:22,886 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,886 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,887 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,893 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,893 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,893 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:22,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,893 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,894 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:22,894 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,894 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 15:31:22,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42251,1689089363923' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 15:31:22,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c8e766e[Count = 1] remaining members to acquire global barrier 2023-07-11 15:31:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:22,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39487,1689089363864' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 15:31:22,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c8e766e[Count = 0] remaining members to acquire global barrier 2023-07-11 15:31:22,899 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 15:31:22,900 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,900 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:22,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:22,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:22,901 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 15:31:22,904 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 15:31:22,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 15:31:22,904 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 15:31:22,904 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:22,904 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,33731,1689089363968' in zk 2023-07-11 15:31:22,905 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 15:31:22,905 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:22,905 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:22,905 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:22,905 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:22,905 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 15:31:22,905 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 15:31:22,905 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:22,905 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 15:31:22,905 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. started... 2023-07-11 15:31:22,905 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. started... 2023-07-11 15:31:22,906 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 30c4ed0e96ea9bd9a8d266d02f2fd319 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-11 15:31:22,906 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 32b06631549ee640f9a2373538205140 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-11 15:31:22,906 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 15:31:22,906 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:22,906 DEBUG [member: 'jenkins-hbase9.apache.org,33731,1689089363968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 15:31:22,966 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711e153b9d1766d461aaa4494e1a1122120 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711e153b9d1766d461aaa4494e1a1122120 2023-07-11 15:31:22,992 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711f736a873e0e04469a88c7290684a1829 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230711f736a873e0e04469a88c7290684a1829 2023-07-11 15:31:23,009 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/.tmp/cf/f6bf8193e15e4985b154d8c13b3497f2 2023-07-11 15:31:23,015 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/.tmp/cf/f6bf8193e15e4985b154d8c13b3497f2 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf/f6bf8193e15e4985b154d8c13b3497f2 2023-07-11 15:31:23,021 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf/f6bf8193e15e4985b154d8c13b3497f2, entries=1, sequenceid=6, filesize=5.1 K 2023-07-11 15:31:23,021 INFO [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 30c4ed0e96ea9bd9a8d266d02f2fd319 in 115ms, sequenceid=6, compaction requested=false 2023-07-11 15:31:23,022 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-11 15:31:23,022 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 30c4ed0e96ea9bd9a8d266d02f2fd319: 2023-07-11 15:31:23,022 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,022 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:23,022 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf/f6bf8193e15e4985b154d8c13b3497f2] hfiles 2023-07-11 15:31:23,022 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf/f6bf8193e15e4985b154d8c13b3497f2 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,100 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. completed. 2023-07-11 15:31:23,100 DEBUG [rs(jenkins-hbase9.apache.org,42251,1689089363923)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:23,101 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:23,101 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:23,101 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,101 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 15:31:23,101 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,42251,1689089363923' in zk 2023-07-11 15:31:23,101 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:23,102 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 15:31:23,103 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 15:31:23,103 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:23,103 DEBUG [member: 'jenkins-hbase9.apache.org,42251,1689089363923' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 15:31:23,103 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:23,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,42251,1689089363923': 2023-07-11 15:31:23,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42251,1689089363923' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 15:31:23,386 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/.tmp/cf/58c269d3fa4f4659b22a152091628976 2023-07-11 15:31:23,393 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/.tmp/cf/58c269d3fa4f4659b22a152091628976 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf/58c269d3fa4f4659b22a152091628976 2023-07-11 15:31:23,397 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf/58c269d3fa4f4659b22a152091628976, entries=49, sequenceid=6, filesize=13.7 K 2023-07-11 15:31:23,398 INFO [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 32b06631549ee640f9a2373538205140 in 492ms, sequenceid=6, compaction requested=false 2023-07-11 15:31:23,400 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32b06631549ee640f9a2373538205140: 2023-07-11 15:31:23,400 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,400 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 15:31:23,400 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf/58c269d3fa4f4659b22a152091628976] hfiles 2023-07-11 15:31:23,400 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf/58c269d3fa4f4659b22a152091628976 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,402 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:23,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:23,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 15:31:23,404 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 15:31:23,416 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. completed. 2023-07-11 15:31:23,416 DEBUG [rs(jenkins-hbase9.apache.org,39487,1689089363864)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:23,416 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 15:31:23,416 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 15:31:23,416 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,416 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 15:31:23,416 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39487,1689089363864' in zk 2023-07-11 15:31:23,418 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,418 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 15:31:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:23,418 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:23,418 DEBUG [member: 'jenkins-hbase9.apache.org,39487,1689089363864' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 15:31:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,39487,1689089363864': 2023-07-11 15:31:23,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39487,1689089363864' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 15:31:23,423 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 15:31:23,424 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 15:31:23,424 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 15:31:23,424 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,424 INFO [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:23,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 15:31:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 15:31:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:23,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:23,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:23,427 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 15:31:23,428 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,428 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 15:31:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,430 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 15:31:23,431 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,431 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:23,434 DEBUG [(jenkins-hbase9.apache.org,35925,1689089362401)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:23,434 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 15:31:23,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:23,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 15:31:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:23,436 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 15:31:23,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,437 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:31:23,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 15:31:23,437 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:23,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:23,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 15:31:23,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:23,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:23,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 15:31:23,437 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:23,437 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:23,437 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,437 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711e153b9d1766d461aaa4494e1a1122120, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230711f736a873e0e04469a88c7290684a1829] mob files 2023-07-11 15:31:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711e153b9d1766d461aaa4494e1a1122120 2023-07-11 15:31:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230711f736a873e0e04469a88c7290684a1829 2023-07-11 15:31:23,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 15:31:23,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,511 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689089482798Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689089483458 (+660 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689089483459 (+1 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689089483459Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689089483465 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689089483487 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689089483511 (+24 ms) 2023-07-11 15:31:23,514 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 15:31:23,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 715 msec 2023-07-11 15:31:23,905 DEBUG [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 15:31:23,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 15:31:23,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 15:31:23,906 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906 2023-07-11 15:31:23,907 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46655, tgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906, rawTgtDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906, srcFsUri=hdfs://localhost:46655, srcDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:31:23,938 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0 2023-07-11 15:31:23,938 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1040935374_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:23,938 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46655, inputRoot=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0, snapshotDir=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-11 15:31:23,960 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:24,031 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,031 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,032 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,032 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,033 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,033 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,034 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,136 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/hadoop-4367496838765356393.jar 2023-07-11 15:31:24,137 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,137 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,138 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,138 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,139 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,139 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 15:31:24,140 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 15:31:24,140 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 15:31:24,141 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 15:31:24,141 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 15:31:24,141 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 15:31:24,142 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 15:31:24,142 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 15:31:24,143 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 15:31:24,143 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 15:31:24,144 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 15:31:24,144 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:24,145 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:24,145 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:31:24,146 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:24,146 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 15:31:24,146 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:31:24,147 DEBUG [Listener at jenkins-hbase9.apache.org/40569] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 15:31:25,842 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0006_000001 (auth:SIMPLE) 2023-07-11 15:31:26,042 WARN [Listener at jenkins-hbase9.apache.org/40569] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 15:31:26,045 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-11 15:31:26,047 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-11 15:31:26,154 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:31:26,154 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 15:31:26,677 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:31:26,861 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0007_000001 (auth:SIMPLE) 2023-07-11 15:31:32,941 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0007_000001 (auth:SIMPLE) 2023-07-11 15:31:35,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689089373136_0007_000001 (auth:SIMPLE) 2023-07-11 15:31:41,401 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 15:31:41,402 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 15:31:41,439 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,439 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 15:31:41,440 INFO [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 15:31:41,440 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,441 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 15:31:41,441 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 15:31:41,441 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1703111169_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,441 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 15:31:41,442 DEBUG [Listener at jenkins-hbase9.apache.org/40569] snapshot.TestExportSnapshot(367): hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/export-test/export-1689089483906/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 15:31:41,473 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 15:31:41,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089501478"}]},"ts":"1689089501478"} 2023-07-11 15:31:41,480 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-11 15:31:41,482 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-11 15:31:41,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, UNASSIGN}] 2023-07-11 15:31:41,485 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, UNASSIGN 2023-07-11 15:31:41,485 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, UNASSIGN 2023-07-11 15:31:41,486 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=30c4ed0e96ea9bd9a8d266d02f2fd319, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:31:41,486 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=32b06631549ee640f9a2373538205140, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:31:41,486 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089501486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089501486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089501486"}]},"ts":"1689089501486"} 2023-07-11 15:31:41,486 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089501486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689089501486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689089501486"}]},"ts":"1689089501486"} 2023-07-11 15:31:41,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 30c4ed0e96ea9bd9a8d266d02f2fd319, server=jenkins-hbase9.apache.org,42251,1689089363923}] 2023-07-11 15:31:41,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 32b06631549ee640f9a2373538205140, server=jenkins-hbase9.apache.org,39487,1689089363864}] 2023-07-11 15:31:41,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 15:31:41,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 30c4ed0e96ea9bd9a8d266d02f2fd319, disabling compactions & flushes 2023-07-11 15:31:41,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. after waiting 0 ms 2023-07-11 15:31:41,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:41,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 32b06631549ee640f9a2373538205140 2023-07-11 15:31:41,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 32b06631549ee640f9a2373538205140, disabling compactions & flushes 2023-07-11 15:31:41,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:41,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:41,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. after waiting 0 ms 2023-07-11 15:31:41,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:41,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:31:41,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:31:41,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:41,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:31:41,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319. 2023-07-11 15:31:41,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140. 2023-07-11 15:31:41,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 30c4ed0e96ea9bd9a8d266d02f2fd319: 2023-07-11 15:31:41,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 32b06631549ee640f9a2373538205140: 2023-07-11 15:31:41,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:41,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=30c4ed0e96ea9bd9a8d266d02f2fd319, regionState=CLOSED 2023-07-11 15:31:41,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 32b06631549ee640f9a2373538205140 2023-07-11 15:31:41,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089501680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089501680"}]},"ts":"1689089501680"} 2023-07-11 15:31:41,686 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=32b06631549ee640f9a2373538205140, regionState=CLOSED 2023-07-11 15:31:41,686 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689089501686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689089501686"}]},"ts":"1689089501686"} 2023-07-11 15:31:41,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-11 15:31:41,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 30c4ed0e96ea9bd9a8d266d02f2fd319, server=jenkins-hbase9.apache.org,42251,1689089363923 in 193 msec 2023-07-11 15:31:41,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-11 15:31:41,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 32b06631549ee640f9a2373538205140, server=jenkins-hbase9.apache.org,39487,1689089363864 in 197 msec 2023-07-11 15:31:41,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=30c4ed0e96ea9bd9a8d266d02f2fd319, UNASSIGN in 210 msec 2023-07-11 15:31:41,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-11 15:31:41,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=32b06631549ee640f9a2373538205140, UNASSIGN in 210 msec 2023-07-11 15:31:41,696 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689089501696"}]},"ts":"1689089501696"} 2023-07-11 15:31:41,697 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-11 15:31:41,700 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-11 15:31:41,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 227 msec 2023-07-11 15:31:41,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 15:31:41,781 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-11 15:31:41,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,785 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,786 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,788 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33731] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,792 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,792 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,792 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,792 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,793 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 15:31:41,793 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 15:31:41,793 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 15:31:41,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 15:31:41,795 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:41,798 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 2023-07-11 15:31:41,800 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/recovered.edits] 2023-07-11 15:31:41,800 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf, FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/recovered.edits] 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:41,803 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 15:31:41,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 15:31:41,814 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf/f6bf8193e15e4985b154d8c13b3497f2 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/cf/f6bf8193e15e4985b154d8c13b3497f2 2023-07-11 15:31:41,815 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf/58c269d3fa4f4659b22a152091628976 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/cf/58c269d3fa4f4659b22a152091628976 2023-07-11 15:31:41,821 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319/recovered.edits/9.seqid 2023-07-11 15:31:41,822 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/30c4ed0e96ea9bd9a8d266d02f2fd319 2023-07-11 15:31:41,823 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/recovered.edits/9.seqid to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140/recovered.edits/9.seqid 2023-07-11 15:31:41,823 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/32b06631549ee640f9a2373538205140 2023-07-11 15:31:41,823 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 15:31:41,824 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-11 15:31:41,825 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-11 15:31:41,830 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711e153b9d1766d461aaa4494e1a1122120 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711e153b9d1766d461aaa4494e1a1122120 2023-07-11 15:31:41,831 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230711f736a873e0e04469a88c7290684a1829 to hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230711f736a873e0e04469a88c7290684a1829 2023-07-11 15:31:41,832 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-11 15:31:41,835 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,837 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-11 15:31:41,840 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-11 15:31:41,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-11 15:31:41,841 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089501841"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:41,841 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689089501841"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:41,844 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 15:31:41,844 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 30c4ed0e96ea9bd9a8d266d02f2fd319, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689089481394.30c4ed0e96ea9bd9a8d266d02f2fd319.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 32b06631549ee640f9a2373538205140, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689089481394.32b06631549ee640f9a2373538205140.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 15:31:41,844 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-11 15:31:41,844 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689089501844"}]},"ts":"9223372036854775807"} 2023-07-11 15:31:41,845 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-11 15:31:41,847 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 66 msec 2023-07-11 15:31:41,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 15:31:41,907 INFO [Listener at jenkins-hbase9.apache.org/40569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-11 15:31:41,915 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 15:31:41,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 15:31:41,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35925] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 15:31:41,951 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 761) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-882282087_1 at /127.0.0.1:46928 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:44686 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:52682 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1703111169_17 at /127.0.0.1:45080 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1744530a-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5660 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-882282087_1 at /127.0.0.1:44988 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase9.apache.org/172.31.2.10:41507 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 912), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=775 (was 746) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=4775 (was 5513) 2023-07-11 15:31:41,951 WARN [Listener at jenkins-hbase9.apache.org/40569] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-11 15:31:41,951 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-11 15:31:41,965 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-11 15:31:42,078 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689089373136_0007_01_000001 is : 143 2023-07-11 15:31:47,268 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 15:31:56,096 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-11 15:32:10,215 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 15:32:10,216 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-11 15:32:10,326 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-11 15:32:10,336 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-11 15:32:10,337 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 15:32:10,351 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-11 15:32:10,455 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 15:32:10,455 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-11 15:32:10,455 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 15:32:10,455 INFO [Listener at jenkins-hbase9.apache.org/40569] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 15:32:10,455 DEBUG [Listener at jenkins-hbase9.apache.org/40569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04d40e34 to 127.0.0.1:55301 2023-07-11 15:32:10,455 DEBUG [Listener at jenkins-hbase9.apache.org/40569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,456 DEBUG [Listener at jenkins-hbase9.apache.org/40569] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 15:32:10,456 DEBUG [Listener at jenkins-hbase9.apache.org/40569] util.JVMClusterUtil(257): Found active master hash=1176885317, stopped=false 2023-07-11 15:32:10,456 DEBUG [Listener at jenkins-hbase9.apache.org/40569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,456 DEBUG [Listener at jenkins-hbase9.apache.org/40569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 15:32:10,456 INFO [Listener at jenkins-hbase9.apache.org/40569] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:32:10,459 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 15:32:10,459 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 15:32:10,459 INFO [Listener at jenkins-hbase9.apache.org/40569] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 15:32:10,459 DEBUG [Listener at jenkins-hbase9.apache.org/40569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f3537f9 to 127.0.0.1:55301 2023-07-11 15:32:10,459 DEBUG [Listener at jenkins-hbase9.apache.org/40569] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,459 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 15:32:10,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:32:10,459 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 15:32:10,459 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:32:10,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:32:10,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:32:10,459 INFO [Listener at jenkins-hbase9.apache.org/40569] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39487,1689089363864' ***** 2023-07-11 15:32:10,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 15:32:10,460 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1064): Closing user regions 2023-07-11 15:32:10,460 DEBUG [Listener at jenkins-hbase9.apache.org/40569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,460 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1064): Closing user regions 2023-07-11 15:32:10,460 INFO [Listener at jenkins-hbase9.apache.org/40569] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 15:32:10,460 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(3305): Received CLOSE for ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:32:10,460 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1064): Closing user regions 2023-07-11 15:32:10,460 INFO [Listener at jenkins-hbase9.apache.org/40569] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,42251,1689089363923' ***** 2023-07-11 15:32:10,460 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(3305): Received CLOSE for c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:32:10,461 DEBUG [Listener at jenkins-hbase9.apache.org/40569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,461 INFO [Listener at jenkins-hbase9.apache.org/40569] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 15:32:10,461 INFO [Listener at jenkins-hbase9.apache.org/40569] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33731,1689089363968' ***** 2023-07-11 15:32:10,461 DEBUG [Listener at jenkins-hbase9.apache.org/40569] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,461 INFO [Listener at jenkins-hbase9.apache.org/40569] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ed3660cccd1e7b944afc8c06ba03c59a, disabling compactions & flushes 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c9ca21890ad83ba9c0679fa2a60fb3bd, disabling compactions & flushes 2023-07-11 15:32:10,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:32:10,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. after waiting 0 ms 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:32:10,462 INFO [RS:0;jenkins-hbase9:39487] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. after waiting 0 ms 2023-07-11 15:32:10,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ed3660cccd1e7b944afc8c06ba03c59a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-11 15:32:10,462 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 15:32:10,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:32:10,462 INFO [RS:1;jenkins-hbase9:42251] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 15:32:10,462 INFO [RS:2;jenkins-hbase9:33731] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 15:32:10,463 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 15:32:10,463 INFO [RS:2;jenkins-hbase9:33731] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 15:32:10,463 INFO [RS:1;jenkins-hbase9:42251] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 15:32:10,463 INFO [RS:2;jenkins-hbase9:33731] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 15:32:10,463 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 15:32:10,463 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:32:10,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing c9ca21890ad83ba9c0679fa2a60fb3bd 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 15:32:10,463 INFO [RS:0;jenkins-hbase9:39487] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 15:32:10,463 INFO [RS:0;jenkins-hbase9:39487] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 15:32:10,463 DEBUG [RS:2;jenkins-hbase9:33731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c7a824 to 127.0.0.1:55301 2023-07-11 15:32:10,463 INFO [RS:1;jenkins-hbase9:42251] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 15:32:10,463 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 15:32:10,463 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:32:10,464 DEBUG [RS:1;jenkins-hbase9:42251] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43965a2a to 127.0.0.1:55301 2023-07-11 15:32:10,464 DEBUG [RS:1;jenkins-hbase9:42251] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,463 DEBUG [RS:2;jenkins-hbase9:33731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,463 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:32:10,464 DEBUG [RS:0;jenkins-hbase9:39487] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c0ba266 to 127.0.0.1:55301 2023-07-11 15:32:10,466 DEBUG [RS:0;jenkins-hbase9:39487] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,466 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 15:32:10,467 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1478): Online Regions={c9ca21890ad83ba9c0679fa2a60fb3bd=hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd.} 2023-07-11 15:32:10,467 INFO [RS:0;jenkins-hbase9:39487] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 15:32:10,467 INFO [RS:0;jenkins-hbase9:39487] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 15:32:10,467 INFO [RS:0;jenkins-hbase9:39487] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 15:32:10,467 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 15:32:10,467 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 15:32:10,467 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 15:32:10,467 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1478): Online Regions={ed3660cccd1e7b944afc8c06ba03c59a=hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a.} 2023-07-11 15:32:10,467 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 15:32:10,468 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-11 15:32:10,469 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 15:32:10,469 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 15:32:10,469 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 15:32:10,469 DEBUG [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1504): Waiting on c9ca21890ad83ba9c0679fa2a60fb3bd 2023-07-11 15:32:10,469 DEBUG [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1504): Waiting on ed3660cccd1e7b944afc8c06ba03c59a 2023-07-11 15:32:10,469 DEBUG [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 15:32:10,469 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 15:32:10,469 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 15:32:10,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-11 15:32:10,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/.tmp/info/484661f4d75d47568e3761038d92bbc2 2023-07-11 15:32:10,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/.tmp/l/2af37dde762f49e0a4b71c8de08f7dfe 2023-07-11 15:32:10,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/.tmp/info/2c83f1e41a214a5d962404b2ca40b492 2023-07-11 15:32:10,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/.tmp/info/484661f4d75d47568e3761038d92bbc2 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/info/484661f4d75d47568e3761038d92bbc2 2023-07-11 15:32:10,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c83f1e41a214a5d962404b2ca40b492 2023-07-11 15:32:10,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2af37dde762f49e0a4b71c8de08f7dfe 2023-07-11 15:32:10,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/.tmp/l/2af37dde762f49e0a4b71c8de08f7dfe as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/l/2af37dde762f49e0a4b71c8de08f7dfe 2023-07-11 15:32:10,510 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 15:32:10,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/info/484661f4d75d47568e3761038d92bbc2, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 15:32:10,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c9ca21890ad83ba9c0679fa2a60fb3bd in 56ms, sequenceid=6, compaction requested=false 2023-07-11 15:32:10,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2af37dde762f49e0a4b71c8de08f7dfe 2023-07-11 15:32:10,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/l/2af37dde762f49e0a4b71c8de08f7dfe, entries=7, sequenceid=18, filesize=5.2 K 2023-07-11 15:32:10,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ed3660cccd1e7b944afc8c06ba03c59a in 69ms, sequenceid=18, compaction requested=false 2023-07-11 15:32:10,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/namespace/c9ca21890ad83ba9c0679fa2a60fb3bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 15:32:10,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:32:10,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c9ca21890ad83ba9c0679fa2a60fb3bd: 2023-07-11 15:32:10,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689089366755.c9ca21890ad83ba9c0679fa2a60fb3bd. 2023-07-11 15:32:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/acl/ed3660cccd1e7b944afc8c06ba03c59a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-11 15:32:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:32:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ed3660cccd1e7b944afc8c06ba03c59a: 2023-07-11 15:32:10,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689089367540.ed3660cccd1e7b944afc8c06ba03c59a. 2023-07-11 15:32:10,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/.tmp/rep_barrier/5004cbee9c1c4bea8abccba5d4996c36 2023-07-11 15:32:10,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5004cbee9c1c4bea8abccba5d4996c36 2023-07-11 15:32:10,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/.tmp/table/23c97d13b02e420b8162be0702f1919d 2023-07-11 15:32:10,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23c97d13b02e420b8162be0702f1919d 2023-07-11 15:32:10,570 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/.tmp/info/2c83f1e41a214a5d962404b2ca40b492 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/info/2c83f1e41a214a5d962404b2ca40b492 2023-07-11 15:32:10,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c83f1e41a214a5d962404b2ca40b492 2023-07-11 15:32:10,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/info/2c83f1e41a214a5d962404b2ca40b492, entries=48, sequenceid=131, filesize=10.3 K 2023-07-11 15:32:10,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/.tmp/rep_barrier/5004cbee9c1c4bea8abccba5d4996c36 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/rep_barrier/5004cbee9c1c4bea8abccba5d4996c36 2023-07-11 15:32:10,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5004cbee9c1c4bea8abccba5d4996c36 2023-07-11 15:32:10,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/rep_barrier/5004cbee9c1c4bea8abccba5d4996c36, entries=13, sequenceid=131, filesize=6.4 K 2023-07-11 15:32:10,582 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/.tmp/table/23c97d13b02e420b8162be0702f1919d as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/table/23c97d13b02e420b8162be0702f1919d 2023-07-11 15:32:10,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23c97d13b02e420b8162be0702f1919d 2023-07-11 15:32:10,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/table/23c97d13b02e420b8162be0702f1919d, entries=24, sequenceid=131, filesize=6.9 K 2023-07-11 15:32:10,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 117ms, sequenceid=131, compaction requested=false 2023-07-11 15:32:10,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-11 15:32:10,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 15:32:10,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 15:32:10,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 15:32:10,599 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 15:32:10,599 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 15:32:10,669 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,42251,1689089363923; all regions closed. 2023-07-11 15:32:10,669 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33731,1689089363968; all regions closed. 2023-07-11 15:32:10,669 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39487,1689089363864; all regions closed. 2023-07-11 15:32:10,689 DEBUG [RS:1;jenkins-hbase9:42251] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs 2023-07-11 15:32:10,689 DEBUG [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs 2023-07-11 15:32:10,690 INFO [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39487%2C1689089363864.meta:.meta(num 1689089366398) 2023-07-11 15:32:10,690 INFO [RS:1;jenkins-hbase9:42251] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42251%2C1689089363923:(num 1689089366033) 2023-07-11 15:32:10,690 DEBUG [RS:2;jenkins-hbase9:33731] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs 2023-07-11 15:32:10,690 DEBUG [RS:1;jenkins-hbase9:42251] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,690 INFO [RS:2;jenkins-hbase9:33731] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33731%2C1689089363968:(num 1689089366039) 2023-07-11 15:32:10,690 DEBUG [RS:2;jenkins-hbase9:33731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,690 INFO [RS:1;jenkins-hbase9:42251] regionserver.LeaseManager(133): Closed leases 2023-07-11 15:32:10,690 INFO [RS:2;jenkins-hbase9:33731] regionserver.LeaseManager(133): Closed leases 2023-07-11 15:32:10,690 INFO [RS:2;jenkins-hbase9:33731] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 15:32:10,691 INFO [RS:2;jenkins-hbase9:33731] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 15:32:10,691 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 15:32:10,691 INFO [RS:2;jenkins-hbase9:33731] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 15:32:10,691 INFO [RS:2;jenkins-hbase9:33731] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 15:32:10,691 INFO [RS:1;jenkins-hbase9:42251] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 15:32:10,692 INFO [RS:1;jenkins-hbase9:42251] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 15:32:10,692 INFO [RS:2;jenkins-hbase9:33731] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33731 2023-07-11 15:32:10,692 INFO [RS:1;jenkins-hbase9:42251] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 15:32:10,693 INFO [RS:1;jenkins-hbase9:42251] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 15:32:10,692 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 15:32:10,694 INFO [RS:1;jenkins-hbase9:42251] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42251 2023-07-11 15:32:10,698 DEBUG [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/oldWALs 2023-07-11 15:32:10,698 INFO [RS:0;jenkins-hbase9:39487] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39487%2C1689089363864:(num 1689089366048) 2023-07-11 15:32:10,698 DEBUG [RS:0;jenkins-hbase9:39487] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,698 INFO [RS:0;jenkins-hbase9:39487] regionserver.LeaseManager(133): Closed leases 2023-07-11 15:32:10,699 INFO [RS:0;jenkins-hbase9:39487] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 15:32:10,699 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 15:32:10,699 INFO [RS:0;jenkins-hbase9:39487] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39487 2023-07-11 15:32:10,702 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:32:10,702 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:32:10,702 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:32:10,702 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39487,1689089363864 2023-07-11 15:32:10,702 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:32:10,702 ERROR [Listener at localhost/34701-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2edc7982 rejected from java.util.concurrent.ThreadPoolExecutor@2ae3e881[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 110] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-11 15:32:10,703 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:32:10,703 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 15:32:10,703 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:32:10,703 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:32:10,704 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:32:10,704 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:32:10,704 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42251,1689089363923 2023-07-11 15:32:10,705 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33731,1689089363968 2023-07-11 15:32:10,707 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,42251,1689089363923] 2023-07-11 15:32:10,708 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,42251,1689089363923; numProcessing=1 2023-07-11 15:32:10,709 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,42251,1689089363923 already deleted, retry=false 2023-07-11 15:32:10,709 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,42251,1689089363923 expired; onlineServers=2 2023-07-11 15:32:10,709 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39487,1689089363864] 2023-07-11 15:32:10,709 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39487,1689089363864; numProcessing=2 2023-07-11 15:32:10,710 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39487,1689089363864 already deleted, retry=false 2023-07-11 15:32:10,710 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39487,1689089363864 expired; onlineServers=1 2023-07-11 15:32:10,710 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,33731,1689089363968] 2023-07-11 15:32:10,710 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,33731,1689089363968; numProcessing=3 2023-07-11 15:32:10,712 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,33731,1689089363968 already deleted, retry=false 2023-07-11 15:32:10,712 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,33731,1689089363968 expired; onlineServers=0 2023-07-11 15:32:10,712 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35925,1689089362401' ***** 2023-07-11 15:32:10,712 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 15:32:10,712 DEBUG [M:0;jenkins-hbase9:35925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@718d27e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 15:32:10,712 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35925,1689089362401 2023-07-11 15:32:10,712 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35925,1689089362401; all regions closed. 2023-07-11 15:32:10,713 DEBUG [M:0;jenkins-hbase9:35925] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 15:32:10,713 DEBUG [M:0;jenkins-hbase9:35925] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 15:32:10,713 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 15:32:10,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689089365565] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689089365565,5,FailOnTimeoutGroup] 2023-07-11 15:32:10,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689089365568] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689089365568,5,FailOnTimeoutGroup] 2023-07-11 15:32:10,713 DEBUG [M:0;jenkins-hbase9:35925] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 15:32:10,713 INFO [M:0;jenkins-hbase9:35925] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 15:32:10,713 INFO [M:0;jenkins-hbase9:35925] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 15:32:10,713 INFO [M:0;jenkins-hbase9:35925] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 15:32:10,713 DEBUG [M:0;jenkins-hbase9:35925] master.HMaster(1512): Stopping service threads 2023-07-11 15:32:10,713 INFO [M:0;jenkins-hbase9:35925] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 15:32:10,714 ERROR [M:0;jenkins-hbase9:35925] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-11 15:32:10,714 INFO [M:0;jenkins-hbase9:35925] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 15:32:10,714 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 15:32:10,715 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 15:32:10,715 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 15:32:10,715 DEBUG [M:0;jenkins-hbase9:35925] zookeeper.ZKUtil(398): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 15:32:10,715 WARN [M:0;jenkins-hbase9:35925] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 15:32:10,715 INFO [M:0;jenkins-hbase9:35925] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 15:32:10,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 15:32:10,715 INFO [M:0;jenkins-hbase9:35925] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 15:32:10,716 DEBUG [M:0;jenkins-hbase9:35925] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 15:32:10,716 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:32:10,716 DEBUG [M:0;jenkins-hbase9:35925] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:32:10,716 DEBUG [M:0;jenkins-hbase9:35925] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 15:32:10,716 DEBUG [M:0;jenkins-hbase9:35925] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:32:10,716 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=451.97 KB 2023-07-11 15:32:10,738 INFO [M:0;jenkins-hbase9:35925] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1bcf0899d89a410dbbda1b906d6a8800 2023-07-11 15:32:10,742 INFO [M:0;jenkins-hbase9:35925] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bcf0899d89a410dbbda1b906d6a8800 2023-07-11 15:32:10,743 DEBUG [M:0;jenkins-hbase9:35925] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1bcf0899d89a410dbbda1b906d6a8800 as hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1bcf0899d89a410dbbda1b906d6a8800 2023-07-11 15:32:10,747 INFO [M:0;jenkins-hbase9:35925] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bcf0899d89a410dbbda1b906d6a8800 2023-07-11 15:32:10,747 INFO [M:0;jenkins-hbase9:35925] regionserver.HStore(1080): Added hdfs://localhost:46655/user/jenkins/test-data/fed34a98-14cb-530f-b5a7-8605e2b229a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1bcf0899d89a410dbbda1b906d6a8800, entries=119, sequenceid=899, filesize=28.6 K 2023-07-11 15:32:10,748 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384686, heapSize ~451.95 KB/462800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=899, compaction requested=false 2023-07-11 15:32:10,749 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 15:32:10,749 DEBUG [M:0;jenkins-hbase9:35925] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 15:32:10,753 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 15:32:10,753 INFO [M:0;jenkins-hbase9:35925] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 15:32:10,754 INFO [M:0;jenkins-hbase9:35925] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35925 2023-07-11 15:32:10,756 DEBUG [M:0;jenkins-hbase9:35925] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35925,1689089362401 already deleted, retry=false 2023-07-11 15:32:10,806 INFO [RS:0;jenkins-hbase9:39487] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39487,1689089363864; zookeeper connection closed. 2023-07-11 15:32:10,806 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:10,806 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:39487-0x10154f309b70001, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:10,806 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@685e7a2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@685e7a2 2023-07-11 15:32:10,906 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:10,906 INFO [M:0;jenkins-hbase9:35925] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35925,1689089362401; zookeeper connection closed. 2023-07-11 15:32:10,906 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): master:35925-0x10154f309b70000, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:11,006 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:11,006 INFO [RS:2;jenkins-hbase9:33731] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33731,1689089363968; zookeeper connection closed. 2023-07-11 15:32:11,006 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:33731-0x10154f309b70003, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:11,007 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@dda86ec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@dda86ec 2023-07-11 15:32:11,106 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:11,107 DEBUG [Listener at localhost/34701-EventThread] zookeeper.ZKWatcher(600): regionserver:42251-0x10154f309b70002, quorum=127.0.0.1:55301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 15:32:11,107 INFO [RS:1;jenkins-hbase9:42251] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,42251,1689089363923; zookeeper connection closed. 2023-07-11 15:32:11,107 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64f19e54] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64f19e54 2023-07-11 15:32:11,107 INFO [Listener at jenkins-hbase9.apache.org/40569] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 15:32:11,108 WARN [Listener at jenkins-hbase9.apache.org/40569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 15:32:11,116 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 15:32:11,221 WARN [BP-1377939126-172.31.2.10-1689089358278 heartbeating to localhost/127.0.0.1:46655] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 15:32:11,221 WARN [BP-1377939126-172.31.2.10-1689089358278 heartbeating to localhost/127.0.0.1:46655] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1377939126-172.31.2.10-1689089358278 (Datanode Uuid eef31c97-ee6f-41e4-b8d0-42775983c7e7) service to localhost/127.0.0.1:46655 2023-07-11 15:32:11,223 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data5/current/BP-1377939126-172.31.2.10-1689089358278] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 15:32:11,224 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data6/current/BP-1377939126-172.31.2.10-1689089358278] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 15:32:11,225 WARN [Listener at jenkins-hbase9.apache.org/40569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 15:32:11,229 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 15:32:11,333 WARN [BP-1377939126-172.31.2.10-1689089358278 heartbeating to localhost/127.0.0.1:46655] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 15:32:11,333 WARN [BP-1377939126-172.31.2.10-1689089358278 heartbeating to localhost/127.0.0.1:46655] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1377939126-172.31.2.10-1689089358278 (Datanode Uuid 40fce270-2a48-4f5c-b083-df49e44d50ad) service to localhost/127.0.0.1:46655 2023-07-11 15:32:11,334 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data3/current/BP-1377939126-172.31.2.10-1689089358278] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 15:32:11,334 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data4/current/BP-1377939126-172.31.2.10-1689089358278] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 15:32:11,335 WARN [Listener at jenkins-hbase9.apache.org/40569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 15:32:11,338 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 15:32:11,445 WARN [BP-1377939126-172.31.2.10-1689089358278 heartbeating to localhost/127.0.0.1:46655] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 15:32:11,445 WARN [BP-1377939126-172.31.2.10-1689089358278 heartbeating to localhost/127.0.0.1:46655] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1377939126-172.31.2.10-1689089358278 (Datanode Uuid fc83c3f1-13ad-4ade-9162-1e7b9de34d96) service to localhost/127.0.0.1:46655 2023-07-11 15:32:11,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data1/current/BP-1377939126-172.31.2.10-1689089358278] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 15:32:11,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d831820-8bd9-af5f-5a45-126d0c3b7d2c/cluster_c41f9aad-109c-a2cb-9fbe-fcd6d112eaa3/dfs/data/data2/current/BP-1377939126-172.31.2.10-1689089358278] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 15:32:11,480 INFO [Listener at jenkins-hbase9.apache.org/40569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 15:32:11,521 INFO [Listener at jenkins-hbase9.apache.org/40569] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 15:32:11,643 INFO [Listener at jenkins-hbase9.apache.org/40569] hbase.HBaseTestingUtility(1293): Minicluster is down